00010000:00010000:1.0F:1789121165.779237:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0F:1789121165.970890:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0F:1789121166.757914:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1789121166.757947:0:17834:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9468852d2600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1789121166.757953:0:17834:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946883466100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946885583000 00000020:00080000:2.0:1789121166.757956:0:17834:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946883466300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9468c14ca200 00010000:00010000:1.0:1789121166.758217:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758309:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758318:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758324:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789121166.758329:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758338:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758359:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121166.758363:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789121166.758369:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121166.758376:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0F:1789121166.758658:0:17894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1789121166.758745:0:17894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789121166.810979:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121167.831606:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121168.273966:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121168.274075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.274185:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733568 00000100:00100000:0.0:1789121168.274195:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733568 00000100:00100000:0.0:1789121168.274382:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789121168.274396:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121168.274437:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121168.274513:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.274524:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789121168.274560:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121168.274622:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121168.275224:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121168.275271:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.275318:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733696 00000100:00100000:0.0:1789121168.275324:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733696 00000100:00100000:0.0:1789121168.275369:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121168.275379:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970733696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789121168.275397:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121168.275442:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970733696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.275452:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121168.275478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970733952:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.275516:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.275567:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970734464:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.275597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.275622:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970734976:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.275650:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.275671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789121168.275678:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970733824:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.275889:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.275980:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970734336:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.276076:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970734848:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.276160:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733952 00000100:00100000:0.0:1789121168.276168:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733952 00000100:00100000:0.0:1789121168.276219:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734336 00000100:00100000:0.0:1789121168.276224:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734336 00000100:00100000:0.0:1789121168.276243:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789121168.276264:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970733952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276326:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970733952:12345-0@lo:400:kworker.0 Request processed in 73us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276337:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789121168.276357:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789121168.276364:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970734336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276408:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970734336:12345-0@lo:400:kworker.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276416:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789121168.276437:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734464 00000100:00100000:0.0:1789121168.276454:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734464 00000100:00100000:0.0:1789121168.276491:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789121168.276499:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970734464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276536:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970734464:12345-0@lo:400:kworker.0 Request processed in 39us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276542:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789121168.276561:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734976 00000100:00100000:0.0:1789121168.276565:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734976 00000100:00100000:0.0:1789121168.276608:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734848 00000100:00100000:0.0:1789121168.276612:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734848 00000100:00100000:0.0:1789121168.276632:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789121168.276639:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970734976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276681:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970734976:12345-0@lo:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276688:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789121168.276700:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789121168.276706:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276743:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970734848:12345-0@lo:400:kworker.0 Request processed in 34us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276749:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789121168.276771:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733824 00000100:00100000:0.0:1789121168.276775:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733824 00000100:00100000:0.0:1789121168.276799:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789121168.276805:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970733824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.276878:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970733824:12345-0@lo:400:kworker.0 Request processed in 72us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.276884:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789121168.276946:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121168.276951:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121168.276953:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121168.276955:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121168.276972:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970734208:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.277021:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970734720:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.277085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970733696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121168.277105:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789121168.277112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970734080:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.277172:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970734592:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.277209:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970735104:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277231:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121168.277256:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734208 00000100:00100000:0.0:1789121168.277260:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734208 00000100:00100000:0.0:1789121168.277282:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734720 00000100:00100000:0.0:1789121168.277285:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734720 00000100:00100000:0.0:1789121168.277302:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734592 00000100:00100000:0.0:1789121168.277305:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734592 00000100:00100000:0.0:1789121168.277315:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735104 00000100:00100000:0.0:1789121168.277317:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735104 00000100:00100000:0.0:1789121168.277331:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789121168.277337:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970734208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277372:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970734208:12345-0@lo:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.277385:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789121168.277398:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789121168.277404:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970734720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277431:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970734720:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.277437:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789121168.277448:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789121168.277453:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970734592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277479:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970734592:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.277485:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789121168.277495:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789121168.277500:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970735104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277529:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970735104:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.277535:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789121168.277552:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970734080 00000100:00100000:0.0:1789121168.277556:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970734080 00000100:00100000:0.0:1789121168.277590:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789121168.277597:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970734080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277625:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970734080:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121168.277631:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789121168.277651:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121168.277654:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121168.277663:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121168.277689:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970734080:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277700:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970734592:0@lo:400:kworker.0 00010000:00080000:0.0:1789121168.277711:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784894780 x1876028970735104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121168.277720:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970735104:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277730:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970734208:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277738:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970734720:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277773:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970733824:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277783:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970734336:0@lo:400:kworker.0 00010000:00080000:0.0:1789121168.277794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784897c00 x1876028970734848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121168.277803:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970734848:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277815:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970734976:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277855:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970733952:0@lo:400:kworker.0 00000100:00100000:0.0:1789121168.277867:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970734464:0@lo:400:kworker.0 00010000:00010000:3.0:1789121168.852203:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121169.235176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121169.235268:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581696 00000100:00100000:2.0:1789121169.235281:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581696 00000100:00100000:2.0:1789121169.235367:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789121169.235379:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:15880:x1876028947581696:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789121169.235482:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:15880:x1876028947581696:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121169.235490:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00080000:0.0:1789121169.235805:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121169.261458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121169.261542:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581824 00000100:00100000:1.0:1789121169.261553:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581824 00000100:00080000:0.0:1789121169.261623:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121169.261640:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789121169.261653:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15880:x1876028947581824:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789121169.261764:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15880:x1876028947581824:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121169.261789:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789121169.279744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.280236:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582080 00000100:00100000:0.0:1789121169.280271:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582080 00000100:00100000:0.0:1789121169.280339:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789121169.280351:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:15880:x1876028947582080:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789121169.280609:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+14:15880:x1876028947582080:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 261us (876us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789121169.280618:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789121169.373288:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373372:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373396:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373438:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373496:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121169.373532:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582336 00000100:00100000:0.0:1789121169.373541:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582336 00000100:00100000:0.0:1789121169.373603:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582464 00000100:00100000:0.0:1789121169.373606:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582464 00000100:00100000:0.0:1789121169.373622:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582848 00000100:00100000:0.0:1789121169.373625:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582848 00000100:00100000:0.0:1789121169.373639:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582976 00000100:00100000:0.0:1789121169.373642:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582976 00000100:00100000:0.0:1789121169.373661:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:0.0:1789121169.373671:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947582336:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121169.373754:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947582336:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121169.373762:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:0.0:1789121169.373781:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789121169.373787:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2408:x1876028947582464:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:0.0:1789121169.373841:0:19367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a10 00000100:00080000:0.0:1789121169.373859:0:19367:0:(import.c:65:import_set_state_nolock()) ffff9468c073e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121169.373906:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789121169.375722:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+2:2408:x1876028947582464:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 1927us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121169.375737:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789121169.375766:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789121169.375777:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2408:x1876028947582848:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:0.0:1789121169.375801:0:19367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a48 00000100:00080000:0.0:1789121169.375812:0:19367:0:(import.c:65:import_set_state_nolock()) ffff946782978000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121169.375880:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00010000:00010000:3.0:1789121169.376185:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121169.376192:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582208 00000100:00100000:2.0:1789121169.376201:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582208 00000100:00100000:2.0:1789121169.376260:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:2.0:1789121169.376268:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947582208:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121169.376301:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947582208:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 34us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121169.376308:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:0.0:1789121169.377004:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+2:2408:x1876028947582848:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 1225us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121169.377013:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789121169.377030:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789121169.377038:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2408:x1876028947582976:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:0.0:1789121169.377059:0:19367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a4f 00000100:00080000:0.0:1789121169.377069:0:19367:0:(import.c:65:import_set_state_nolock()) ffff94678297c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121169.377117:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789121169.377187:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+2:2408:x1876028947582976:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 149us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121169.377194:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789121169.377218:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582720 00000100:00100000:0.0:1789121169.377222:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582720 00000100:00100000:0.0:1789121169.377269:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947582592 00000100:00100000:0.0:1789121169.377282:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947582592 00000100:00080000:2.0:1789121169.377284:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121169.377288:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789121169.377290:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121169.377292:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121169.377310:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:2.0:1789121169.377319:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947582720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121169.377355:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947582720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 38us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121169.377372:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:2.0:1789121169.377388:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789121169.377396:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2412:x1876028947582592:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121169.377425:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2412:x1876028947582592:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121169.377433:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00010000:00010000:3.0:1789121169.377590:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121169.378222:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121169.874168:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121170.322242:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121170.322275:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970735232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121170.322354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121170.322409:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735232 00000100:00100000:2.0:1789121170.322415:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735232 00000100:00100000:2.0:1789121170.322456:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789121170.322464:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970735232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121170.322497:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789121170.322538:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970735232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121170.322545:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789121170.322584:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970735232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121170.322779:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970735360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121170.322815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121170.322896:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735360 00000100:00100000:3.0:1789121170.322901:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735360 00000100:00100000:3.0:1789121170.322948:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789121170.322956:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970735360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121170.322978:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789121170.323026:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970735360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121170.323032:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789121170.323069:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970735360:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789121170.327235:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121170.327259:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121170.327279:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970735616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121170.327327:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970735488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121170.327368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121170.327378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121170.327433:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735616 00000100:00100000:3.0:1789121170.327434:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735488 00000100:00100000:3.0:1789121170.327442:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735488 00000100:00100000:2.0:1789121170.327442:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735616 00000100:00100000:2.0:1789121170.327503:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789121170.327505:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121170.327516:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970735488:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121170.327541:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970735616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121170.327579:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121170.327625:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970735616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121170.327632:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789121170.327680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970735616:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1789121170.327719:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789121170.354674:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789121170.354797:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970735488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 27279us (27415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121170.354808:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789121170.355003:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970735488:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1789121170.647517:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789121170.647527:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789121170.647575:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789121170.647585:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789121170.898130:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121171.923622:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789121172.883687:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1789121172.883702:0:17834:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1789121172.883748:0:17894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1789121172.883761:0:17894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:0.0:1789121172.946085:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789121173.222740:0:21242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 06:06:11 (1789121171) 00000100:00100000:0.0:1789121173.394491:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121173.394516:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970735872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121173.394644:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121173.399157:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970735744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121173.399267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121173.399378:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735872 00000100:00100000:1.0:1789121173.399386:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735872 00000100:00100000:1.0:1789121173.399443:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970735744 00000100:00100000:1.0:1789121173.399447:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970735744 00000100:00100000:1.0:1789121173.399471:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789121173.399479:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970735872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789121173.399514:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789121173.399561:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970735872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (4917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121173.399569:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789121173.399585:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789121173.399591:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970735744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789121173.399600:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789121173.399628:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970735744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121173.399634:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789121173.399649:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121173.399688:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970735872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121173.399734:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970735744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121173.401706:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970736000:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.401779:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.401816:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970736512:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.401875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.401903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970737024:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.401927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.401951:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789121173.401958:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970736384:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.402288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.402309:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970736896:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.402333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.402365:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970736128:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.402390:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.402438:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970736640:0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.405709:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736512 00000100:00100000:2.0:1789121173.405725:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736512 00000100:00100000:2.0:1789121173.405778:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736128 00000100:00100000:2.0:1789121173.405782:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736128 00000100:00100000:2.0:1789121173.405804:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789121173.405814:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970736512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.406108:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970736512:12345-0@lo:400:kworker.0 Request processed in 294us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.406116:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789121173.406135:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789121173.406141:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970736128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.406174:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970736128:12345-0@lo:400:kworker.0 Request processed in 33us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.406181:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789121173.408011:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737024 00000100:00100000:2.0:1789121173.408026:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737024 00000100:00100000:2.0:1789121173.408110:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736384 00000100:00100000:2.0:1789121173.408114:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736384 00000100:00100000:2.0:1789121173.408151:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736896 00000100:00100000:2.0:1789121173.408154:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736896 00000100:00100000:2.0:1789121173.408174:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789121173.408182:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970737024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.408439:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970737024:12345-0@lo:400:kworker.0 Request processed in 257us (6509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.408446:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789121173.408464:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789121173.408470:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970736384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.408498:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970736384:12345-0@lo:400:kworker.0 Request processed in 29us (6211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.408504:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789121173.408515:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789121173.408520:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.408548:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970736896:12345-0@lo:400:kworker.0 Request processed in 28us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.408554:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789121173.408814:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970736384:0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.408853:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970736896:0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.408868:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970736512:0@lo:400:kworker.0 00010000:00080000:2.0:1789121173.408881:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784895e00 x1876028970737024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121173.408892:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970737024:0@lo:400:kworker.0 00000100:00080000:2.0:1789121173.408924:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121173.408935:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121173.412393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.412439:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970737152:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.412548:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970736128:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412564:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789121173.412572:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970736256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.412633:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970736768:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.412667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970737280:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412690:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121173.412740:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736000 00000100:00100000:3.0:1789121173.412746:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736000 00000100:00100000:3.0:1789121173.412788:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789121173.412796:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970736000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.412865:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970736000:12345-0@lo:400:kworker.0 Request processed in 70us (11087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121173.412874:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789121173.412912:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737152 00000100:00100000:3.0:1789121173.412916:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737152 00000100:00100000:3.0:1789121173.412942:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736768 00000100:00100000:3.0:1789121173.412944:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736768 00000100:00100000:3.0:1789121173.412954:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737280 00000100:00100000:3.0:1789121173.412957:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737280 00000100:00100000:3.0:1789121173.412970:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789121173.412975:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970737152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.413010:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970737152:12345-0@lo:400:kworker.0 Request processed in 34us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121173.413017:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789121173.413028:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789121173.413034:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970736768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.413057:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970736768:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121173.413063:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789121173.413182:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789121173.413192:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970737280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.413304:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970737280:12345-0@lo:400:kworker.0 Request processed in 115us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.413311:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789121173.413332:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736640 00000100:00100000:2.0:1789121173.413335:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736640 00000100:00100000:2.0:1789121173.413360:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970736256 00000100:00100000:2.0:1789121173.413363:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970736256 00000100:00100000:2.0:1789121173.413379:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789121173.413385:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970736640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.413415:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970736640:12345-0@lo:400:kworker.0 Request processed in 31us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.413422:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789121173.413433:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121173.413440:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970736256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121173.413467:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970736256:12345-0@lo:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121173.413472:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121173.413508:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970736000:0@lo:400:kworker.0 00000100:00080000:2.0:1789121173.413528:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789121173.413532:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121173.413534:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121173.418502:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970736256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.418523:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970736768:0@lo:400:kworker.0 00010000:00080000:3.0:1789121173.418540:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848961c0 x1876028970737280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121173.418573:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970737280:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.418588:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789121173.418600:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970737152:0@lo:400:kworker.0 00010000:00010000:3.0:1789121173.969984:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121174.477668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477754:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121174.477840:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583360 00000100:00100000:0.0:1789121174.477850:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583360 00000100:00100000:0.0:1789121174.477910:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583616 00000100:00100000:0.0:1789121174.477913:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583616 00000100:00100000:0.0:1789121174.477927:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583232 00000100:00100000:0.0:1789121174.477929:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583232 00000100:00100000:0.0:1789121174.477940:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583744 00000100:00100000:0.0:1789121174.477943:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583744 00000100:00100000:0.0:1789121174.477960:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789121174.477970:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947583360:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121174.478040:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947583360:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121174.478072:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789121174.478099:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:0.0:1789121174.478106:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947583616:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121174.478134:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947583616:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121174.478140:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:0.0:1789121174.478150:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789121174.478157:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:2411:x1876028947583232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121174.478183:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:2411:x1876028947583232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121174.478189:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789121174.478201:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789121174.478217:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947583744:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121174.478241:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947583744:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121174.478247:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789121174.478273:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583488 00000100:00100000:0.0:1789121174.478276:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583488 00000100:00100000:0.0:1789121174.478304:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789121174.478312:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947583488:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121174.478335:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947583488:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121174.478340:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00080000:0.0:1789121174.478365:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121174.478370:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121174.478372:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121174.482472:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947583104 00000100:00100000:3.0:1789121174.482487:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947583104 00000100:00100000:3.0:1789121174.482574:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:3.0:1789121174.482585:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947583104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121174.482665:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947583104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 82us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121174.482674:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 171 00000001:00100000:0.0:1789121174.939774:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000020:00000080:0.0:1789121174.939786:0:20185:0:(genops.c:885:class_export_put()) final put ffff94678297a000/0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00100000:0.0:1789121174.939809:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:0.0:1789121174.939811:0:20185:0:(genops.c:885:class_export_put()) final put ffff9468c073a800/7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:3.0:1789121174.939981:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff94678297a000/0d1c643e-f8d1-4998-bc1e-8baa38374a62 for lustre-OST0001 00000020:00000080:3.0:1789121174.940033:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c073a800/7f977f21-a57c-43c4-b0be-1d901bfa40b7 for lustre-OST0001 00000020:00000080:3.0:1789121174.940051:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94678297c000 for lustre-OST0001 00000020:00000080:3.0:1789121174.940067:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c073e800 for lustre-OST0001 00000001:00100000:3.0:1789121174.949086:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000020:00000080:3.0:1789121174.949102:0:19362:0:(genops.c:885:class_export_put()) final put ffff94678297a800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000020:00000080:2.0:1789121174.949240:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff94678297a800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 for lustre-OST0000 00000020:00000080:2.0:1789121174.949369:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782978000 for lustre-OST0000 00010000:00010000:1.0:1789121174.996956:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121175.187347:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789121175.448452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970737408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121175.448931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121175.450577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121175.450600:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970737536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121175.450669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121175.450880:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737408 00000100:00100000:0.0:1789121175.450899:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737408 00000100:00100000:0.0:1789121175.450978:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789121175.450991:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970737408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789121175.451025:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121175.451122:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970737408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121175.451130:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789121175.451154:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121175.451404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970737664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121175.451443:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121175.452211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970737408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121175.452516:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737664 00000100:00100000:0.0:1789121175.452524:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737664 00000100:00100000:0.0:1789121175.452574:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789121175.452583:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970737664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121175.452606:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121175.452658:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970737664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121175.452666:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789121175.452690:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121175.452761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970737664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121175.452780:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121175.452787:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970737792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121175.452847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121175.454221:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737536 00000100:00100000:2.0:1789121175.454233:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737536 00000100:00100000:2.0:1789121175.454420:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737792 00000100:00100000:2.0:1789121175.454431:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737792 00000100:00100000:2.0:1789121175.454477:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789121175.454486:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970737536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121175.454519:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121175.454585:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970737536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121175.454593:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789121175.454608:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789121175.454613:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970737792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121175.454630:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789121175.454665:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970737792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121175.454671:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789121175.454718:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970737792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121175.456389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970737536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789121176.019643:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121177.042154:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121178.067281:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121178.107708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121178.107867:0:17857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947584000 00000100:00100000:0.0:1789121178.107881:0:17857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947584000 00000100:00100000:0.0:1789121178.107981:0:17857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789121178.107997:0:17857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+13:16642:x1876028947584000:12345-192.168.202.32@tcp:35:umount.0 00000001:00080000:0.0:1789121178.108362:0:17857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789121178.108461:0:17857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1789121178.108642:0:17857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:16642:x1876028947584000:12345-192.168.202.32@tcp:35:umount.0 Request processed in 647us (949us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1789121178.108652:0:17857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000020:00080000:0.0:1789121178.108658:0:17857:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1789121178.108762:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121178.125459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121178.125537:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947584128 00000100:00100000:1.0:1789121178.125549:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947584128 00000100:00100000:1.0:1789121178.125806:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:1.0:1789121178.125882:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947584128:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121178.125904:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121178.125930:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55600/0xb74d2367a83109e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edcf expref: 13 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.125949:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121178.126021:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+12:2411:x1876028947584128:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 203us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.126040:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789121178.138180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121178.138297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121178.149470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121178.150217:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947584512 00000100:00100000:2.0:1789121178.150229:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947584512 00000100:00100000:2.0:1789121178.150308:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789121178.150320:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2408:x1876028947584512:12345-192.168.202.32@tcp:9:umount.0 00000020:00000080:2.0:1789121178.150357:0:20006:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a09 00000100:00080000:2.0:1789121178.150368:0:20006:0:(import.c:65:import_set_state_nolock()) ffff9468c073c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121178.150437:0:20006:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789121178.150611:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+2:2408:x1876028947584512:12345-192.168.202.32@tcp:9:umount.0 Request processed in 292us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121178.150620:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00010000:00010000:2.0:1789121178.150682:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121178.150993:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121178.152765:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947584256 00000100:00100000:1.0:1789121178.152778:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947584256 00000100:00100000:1.0:1789121178.157563:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947584384 00000100:00100000:1.0:1789121178.157578:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947584384 00000100:00100000:3.0:1789121178.157625:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789121178.157637:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789121178.157638:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947584256:12345-192.168.202.32@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789121178.157643:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42aa198-48db-4e57-bdde-271b173b12cf+13:2412:x1876028947584384:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121178.157656:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121178.157664:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121178.157677:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55000/0xb74d2367a83109ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee00 expref: 13 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.157677:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55e00/0xb74d2367a8310aaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeb6 expref: 13 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121178.157695:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789121178.157695:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121178.157765:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+11:2411:x1876028947584256:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 130us (19595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121178.157775:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789121178.160929:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42aa198-48db-4e57-bdde-271b173b12cf+10:2412:x1876028947584384:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 3271us (22617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.160945:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:2.0:1789121178.162899:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121178.164256:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947585408 00000100:00100000:0.0:1789121178.164269:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947585408 00000100:00100000:0.0:1789121178.164342:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121178.164352:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:2408:x1876028947585408:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:0.0:1789121178.164385:0:19756:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83109fb 00000020:00010000:0.0:1789121178.164401:0:19756:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946782aec000: total 0 00000100:00080000:0.0:1789121178.164407:0:19756:0:(import.c:65:import_set_state_nolock()) ffff9468afd4b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121178.164439:0:19756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:1.0:1789121178.164871:0:17842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946782aec000: total 0 00010000:00010000:1.0:1789121178.164876:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121178.164934:0:17842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946782aec000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789121178.164968:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff946888a7fc00) 00010000:00010000:1.0:1789121178.164971:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121178.164979:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eebd expref: 15 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165004:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:1.0:1789121178.165006:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789121178.165009:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eefc expref: 14 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165022:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121178.165034:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789121178.165038:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 13 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165051:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121178.165053:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789121178.165057:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef26 expref: 12 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165087:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121178.165090:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789121178.165107:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310d0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef73 expref: 11 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165127:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468b9862d00) 00010000:00010000:1.0:1789121178.165139:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789121178.165143:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8310ae2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eec4 expref: 10 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165158:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:1.0:1789121178.165160:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121178.165164:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed2 expref: 9 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165174:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121178.165176:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789121178.165180:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a8310cb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef50 expref: 8 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121178.165194:0:17842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946782aec000, canceled 8 locks, left on hash table 0. 00000100:00100000:0.0:1789121178.165196:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2408:x1876028947585408:12345-192.168.202.32@tcp:39:umount.0 Request processed in 845us (2307us total) trans 8589934627 rc 0/0 00010000:00010000:1.0:1789121178.165217:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121178.165219:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121178.165221:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121178.165279:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:2.0:1789121178.192668:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121178.192886:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947585536 00000100:00100000:0.0:1789121178.192896:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947585536 00000100:00100000:0.0:1789121178.192994:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789121178.193006:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2408:x1876028947585536:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:0.0:1789121178.193049:0:17856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a02 00000100:00080000:0.0:1789121178.193067:0:17856:0:(import.c:65:import_set_state_nolock()) ffff9468c0738800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121178.193105:0:17856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789121178.193358:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+3:2408:x1876028947585536:12345-192.168.202.32@tcp:39:umount.0 Request processed in 354us (701us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789121178.193367:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00080000:3.0:1789121178.193539:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789121178.194018:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121178.514325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970737920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789121178.514402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.514485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121178.514492:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970738048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789121178.514519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121178.514599:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970737920 00000100:00100000:0.0:1789121178.514607:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970737920 00000100:00100000:0.0:1789121178.514662:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738048 00000100:00100000:0.0:1789121178.514665:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738048 00000100:00100000:0.0:1789121178.514686:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789121178.514695:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970737920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121178.514731:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121178.514780:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970737920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121178.514788:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789121178.514804:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789121178.514811:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970738048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789121178.514849:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121178.514874:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970738048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121178.514881:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789121178.514921:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970738048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121178.514951:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970737920:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789121178.515088:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789121178.515472:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970738176:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970738688:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515569:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515586:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970739200:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789121178.515633:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970738304:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515667:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970738816:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515703:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970739328:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515737:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121178.515763:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738688 00000100:00100000:2.0:1789121178.515769:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738688 00000100:00100000:2.0:1789121178.515798:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738304 00000100:00100000:2.0:1789121178.515801:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738304 00000100:00100000:2.0:1789121178.515815:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789121178.515847:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970738688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515888:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970738688:12345-0@lo:400:kworker.0 Request processed in 42us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121178.515896:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789121178.515909:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789121178.515916:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970738304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.515957:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970738304:12345-0@lo:400:kworker.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121178.515964:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789121178.515995:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970738304:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.516006:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970738688:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516137:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970738432:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121178.516206:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970738944:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121178.516244:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970739456:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121178.516290:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789121178.516296:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970738560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121178.516334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121178.516373:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739200 00000100:00100000:1.0:1789121178.516377:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739200 00000100:00100000:1.0:1789121178.516408:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739328 00000100:00100000:1.0:1789121178.516412:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739328 00000100:00100000:1.0:1789121178.516425:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738944 00000100:00100000:1.0:1789121178.516428:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738944 00000100:00100000:1.0:1789121178.516439:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739456 00000100:00100000:1.0:1789121178.516441:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739456 00000100:00100000:1.0:1789121178.516452:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738560 00000100:00100000:1.0:1789121178.516454:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738560 00000100:00100000:1.0:1789121178.516464:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739072 00000100:00100000:1.0:1789121178.516466:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739072 00000100:00100000:1.0:1789121178.516478:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789121178.516485:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970739200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516523:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970739200:12345-0@lo:400:kworker.0 Request processed in 37us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516529:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789121178.516543:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789121178.516549:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970739328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516575:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970739328:12345-0@lo:400:kworker.0 Request processed in 27us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516582:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789121178.516592:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789121178.516598:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970738944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516637:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970738944:12345-0@lo:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516643:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789121178.516654:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789121178.516661:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970739456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516686:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970739456:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516692:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789121178.516703:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789121178.516709:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970738560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516735:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970738560:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516741:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789121178.516769:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789121178.516775:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970739072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516801:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970739072:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121178.516807:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789121178.516857:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789121178.516862:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121178.516881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970738560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516892:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970739072:0@lo:400:kworker.0 00000100:00100000:1.0:1789121178.516901:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970738944:0@lo:400:kworker.0 00010000:00080000:1.0:1789121178.516913:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848fa940 x1876028970739456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121178.516947:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970739456:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.517162:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738816 00000100:00100000:2.0:1789121178.517176:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738816 00000100:00100000:2.0:1789121178.517217:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738432 00000100:00100000:2.0:1789121178.517220:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738432 00000100:00100000:2.0:1789121178.517240:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789121178.517247:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970738816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.517283:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970738816:12345-0@lo:400:kworker.0 Request processed in 37us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121178.517289:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789121178.517309:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789121178.517315:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970738432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.517349:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970738432:12345-0@lo:400:kworker.0 Request processed in 34us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121178.517355:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789121178.517388:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970738816:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.517401:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970739328:0@lo:400:kworker.0 00010000:00080000:2.0:1789121178.517412:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ef480 x1876028970739200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121178.517421:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970739200:0@lo:400:kworker.0 00000100:00100000:2.0:1789121178.517448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970738432:0@lo:400:kworker.0 00000100:00100000:0.0:1789121178.517569:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970738176 00000100:00100000:0.0:1789121178.517574:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970738176 00000100:00100000:0.0:1789121178.517654:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789121178.517662:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3644:x1876028970738176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121178.517702:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3644:x1876028970738176:12345-0@lo:400:kworker.0 Request processed in 41us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121178.517708:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789121178.517760:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970738176:0@lo:400:kworker.0 00000100:00080000:1.0:1789121178.518260:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789121179.090439:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121179.600006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121179.600069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121179.600126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121179.600215:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947585920 00000100:00100000:0.0:1789121179.600225:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947585920 00000100:00100000:0.0:1789121179.600300:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947585792 00000100:00100000:0.0:1789121179.600303:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947585792 00000100:00100000:0.0:1789121179.600327:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789121179.600337:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947585920:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121179.600426:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947585920:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121179.600435:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789121179.600452:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:0.0:1789121179.600459:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2410:x1876028947585792:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121179.600722:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2410:x1876028947585792:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121179.600732:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:2.0:1789121179.600994:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947585664 00000100:00100000:2.0:1789121179.600999:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947585664 00000100:00100000:2.0:1789121179.601049:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:2.0:1789121179.601057:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+10:2410:x1876028947585664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121179.601088:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+10:2410:x1876028947585664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121179.601095:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00080000:1.0:1789121179.601787:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789121179.601794:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789121180.114465:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121180.562255:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121180.562281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970739584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121180.562354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121180.562488:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739584 00000100:00100000:0.0:1789121180.562496:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739584 00000100:00100000:0.0:1789121180.562561:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789121180.562572:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970739584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121180.562619:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121180.562679:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970739584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121180.562687:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789121180.562710:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970739712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121180.562750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121180.562773:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121180.562779:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970739840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121180.562803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121180.562858:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739712 00000100:00100000:0.0:1789121180.562863:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739712 00000100:00100000:0.0:1789121180.562889:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739840 00000100:00100000:0.0:1789121180.562892:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739840 00000100:00100000:0.0:1789121180.562907:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789121180.562913:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970739712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121180.562937:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789121180.562976:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970739712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121180.562983:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789121180.562994:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789121180.563011:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970739840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789121180.563030:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789121180.563065:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970739840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121180.563072:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789121180.563117:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970739584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121180.563163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970739840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121180.563176:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970739712:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789121180.563521:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121180.568361:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789121180.568385:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970739968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121180.568687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121180.568743:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970739968 00000100:00100000:3.0:1789121180.568749:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970739968 00000100:00100000:3.0:1789121180.568843:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789121180.568853:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970739968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121180.568877:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789121180.568923:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970739968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121180.568945:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789121180.568998:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970739968:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789121180.573788:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789121180.882105:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789121180.882122:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789121180.882146:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789121180.882155:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789121181.138054:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121181.205681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121181.205733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121181.205766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121181.205906:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586048 00000100:00100000:3.0:1789121181.205923:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586048 00000100:00100000:3.0:1789121181.206030:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586304 00000100:00100000:3.0:1789121181.206034:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586304 00000100:00100000:3.0:1789121181.206057:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586176 00000100:00100000:3.0:1789121181.206060:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586176 00000100:00100000:1.0:1789121181.206092:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789121181.206121:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+12:2409:x1876028947586048:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121181.206145:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121181.206170:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2e00/0xb74d2367a8310a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee3f expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121181.206190:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121181.206248:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+11:2409:x1876028947586048:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 144us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121181.215414:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121181.215458:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+11:2409:x1876028947586304:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121181.215490:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121181.215530:0:17840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2200/0xb74d2367a8310aa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeaf expref: 11 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121181.215636:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121181.219786:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+10:2409:x1876028947586304:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 4332us (14030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121181.219808:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121181.219958:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789121181.219976:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+9:2409:x1876028947586176:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121181.220070:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789121181.220071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:3.0:1789121181.220118:0:17840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa991200/0xb74d2367a8310a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee70 expref: 9 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121181.220146:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121181.220246:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+8:2409:x1876028947586176:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 277us (14478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121181.220279:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789121181.220477:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586560 00000100:00100000:2.0:1789121181.220489:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586560 00000100:00100000:2.0:1789121181.220603:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789121181.220613:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2408:x1876028947586560:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:2.0:1789121181.220662:0:17856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a41 00000020:00010000:2.0:1789121181.220671:0:17856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94678297d800: total 0 00000100:00080000:2.0:1789121181.220677:0:17856:0:(import.c:65:import_set_state_nolock()) ffff94678297e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121181.220707:0:17856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1789121181.220895:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2408:x1876028947586560:12345-192.168.202.32@tcp:39:umount.0 Request processed in 282us (834us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789121181.220906:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:1.0:1789121181.220917:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000020:00010000:0.0:1789121181.221007:0:17843:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94678297d800: total 0 00010000:00010000:0.0:1789121181.221069:0:17843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94678297d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789121181.221110:0:17843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:0.0:1789121181.221114:0:17843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789121181.221123:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed9 expref: 4 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121181.221149:0:17843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94678297d800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789121181.221257:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121181.221260:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121181.221262:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121181.221907:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121181.234137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121181.234321:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586688 00000100:00100000:2.0:1789121181.234331:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586688 00000100:00080000:3.0:1789121181.234408:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789121181.234413:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:2.0:1789121181.234423:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2408:x1876028947586688:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:2.0:1789121181.234466:0:17854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310a3a 00000100:00080000:2.0:1789121181.234476:0:17854:0:(import.c:65:import_set_state_nolock()) ffff9468c0782800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121181.234510:0:17854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1789121181.234656:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+3:2408:x1876028947586688:12345-192.168.202.32@tcp:39:umount.0 Request processed in 234us (530us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789121181.234665:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00010000:00010000:1.0:1789121181.234768:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121181.272136:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121181.272264:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947586944 00000100:00100000:2.0:1789121181.272274:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947586944 00000100:00100000:2.0:1789121181.272339:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:2.0:1789121181.272351:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+7:2408:x1876028947586944:12345-192.168.202.32@tcp:251:umount.0 00000020:00000080:2.0:1789121181.272397:0:17848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83109d8 00000020:00010000:2.0:1789121181.272405:0:17848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946782aee800: total 0 00000100:00080000:2.0:1789121181.272423:0:17848:0:(import.c:65:import_set_state_nolock()) ffff946782aef000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789121181.272506:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+3:2408:x1876028947586944:12345-192.168.202.32@tcp:251:umount.0 Request processed in 157us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121181.272515:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 174 00000020:00010000:0.0:1789121181.272632:0:17843:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946782aee800: total 0 00010000:00010000:0.0:1789121181.272637:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121181.272690:0:17843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946782aee800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789121181.272730:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990e00/0xb74d2367a83109df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edc8 expref: 2 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121181.272744:0:17843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946782aee800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789121181.272754:0:17843:0:(genops.c:885:class_export_put()) final put ffff946782aee800/d42aa198-48db-4e57-bdde-271b173b12cf 00010000:00010000:0.0:1789121181.272781:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121181.272783:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121181.272785:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789121181.273075:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aee800/d42aa198-48db-4e57-bdde-271b173b12cf for MGS 00000020:00000080:2.0:1789121181.273113:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782aef000 for MGS 00010000:00010000:1.0:1789121182.168746:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121183.186000:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789121183.416690:0:21438:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789121183.433069:0:21438:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789121183.434226:0:21438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.434246:0:21438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.434255:0:21438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.434263:0:21438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.434283:0:21438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789121183.434289:0:21438:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789121183.434323:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121183.434328:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121183.434333:0:21438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121183.434357:0:21438:0:(import.c:65:import_set_state_nolock()) ffff946783de9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789121183.435015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970740096:0@lo:39:umount.0 00000100:00100000:3.0:1789121183.435093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121183.436914:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740096 00000100:00100000:3.0:1789121183.436926:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740096 00000100:00100000:3.0:1789121183.436987:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789121183.436997:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876028970740096:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789121183.437040:0:17855:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83105cc 00000100:00080000:3.0:1789121183.437049:0:17855:0:(import.c:65:import_set_state_nolock()) ffff9468c1918000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789121183.437262:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121183.437273:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.437285:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ae00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121183.437290:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.437300:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121183.437309:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121183.437316:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121183.437318:0:17843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789121183.437321:0:17843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789121183.437355:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.437362:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121183.437386:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.437393:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.437409:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121183.437410:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121183.437412:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121183.437425:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970740224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121183.437574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789121183.438647:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121183.442137:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740224 00000100:00100000:2.0:1789121183.442153:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740224 00000100:00100000:2.0:1789121183.442240:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789121183.442251:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970740224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121183.442268:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121183.442288:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3aa00/0xb74d2367a83105a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a831059b expref: 24 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121183.442308:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121183.442390:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:3647:x1876028970740224:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (4816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.442398:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789121183.442446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970740224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121183.450341:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876028970740096:12345-0@lo:39:umount.0 Request processed in 13332us (15234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121183.450357:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1789121183.450377:0:17855:0:(genops.c:885:class_export_put()) final put ffff9468c191a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789121183.450594:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789121183.450651:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c1918000 for lustre-MDT0000 00000100:00080000:0.0:1789121183.450859:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789121183.450876:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970740096:0@lo:39:umount.0 00000100:00080000:3.0:1789121183.450996:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121183.451005:0:21438:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946891480000 x1876028970740096/t0(0) o39->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121193 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121183.451015:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789121183.451019:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789121183.454518:0:21438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454539:0:21438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454547:0:21438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454555:0:21438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454612:0:21438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121183.454620:0:21438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454627:0:21438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454656:0:21438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.454662:0:21438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454719:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121183.454727:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454734:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121183.454745:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454754:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121183.454762:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121183.454768:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121183.454770:0:17843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789121183.454804:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454811:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121183.454873:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454888:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454902:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121183.454910:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454915:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121183.454918:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454924:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121183.454930:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121183.454935:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121183.454937:0:17843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1789121183.454951:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454956:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121183.454963:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121183.454970:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121183.454972:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121183.454983:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121183.455254:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970740352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121183.455326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.455388:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121183.455395:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970740480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121183.455419:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.455452:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740352 00000100:00100000:1.0:1789121183.455459:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740352 00000100:00100000:1.0:1789121183.455503:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740480 00000100:00100000:1.0:1789121183.455506:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740480 00000100:00100000:1.0:1789121183.455528:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121183.455537:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3644:x1876028970740352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121183.455551:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121183.455566:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d400/0xb74d2367a83104f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83104ec expref: 24 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.455581:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121183.455614:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:3644:x1876028970740352:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121183.455622:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121183.455639:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121183.455644:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:3644:x1876028970740480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121183.455652:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121183.455659:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1200/0xb74d2367a83108ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83108f8 expref: 22 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.455679:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121183.455700:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3644:x1876028970740480:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121183.455707:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121183.455781:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970740480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121183.455791:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970740352:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121183.456335:0:21438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121183.456343:0:21438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121183.456357:0:21438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789121183.456370:0:21438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456378:0:21438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456385:0:21438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456392:0:21438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.456425:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121183.456433:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.456441:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121183.456444:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.456452:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121183.456459:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121183.456465:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789121183.456468:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789121183.456488:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.456495:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789121183.456544:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970740608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121183.456586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789121183.456650:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.456675:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.456677:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.456679:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121183.456729:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740608 00000100:00100000:2.0:1789121183.456734:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740608 00000100:00100000:2.0:1789121183.456789:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121183.456796:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970740608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121183.456807:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121183.456841:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990200/0xb74d2367a8310a9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310a95 expref: 21 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121183.456859:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789121183.456926:0:21438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121183.456931:0:21438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121183.456942:0:21438:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789121183.456956:0:21438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456964:0:21438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456970:0:21438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456987:0:21438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121183.456999:0:21438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789121183.457002:0:21438:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789121183.457006:0:21438:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789121183.457045:0:21438:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789121183.457051:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789121183.457056:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121183.457062:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789121183.457067:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff946783e8c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121183.457086:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9468afd57800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121183.457090:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9468c081c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121183.457095:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9468c191c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121183.457103:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff94678297d800 0d1c643e-f8d1-4998-bc1e-8baa38374a62 192.168.202.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789121183.457108:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff946782aec000 7f977f21-a57c-43c4-b0be-1d901bfa40b7 192.168.202.32@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1789121183.457114:0:21438:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff94678285ced8) has exports, disconnecting them 00000020:00080000:3.0:1789121183.457118:0:21438:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff946783e8c800), last request at 1789121178 00000020:00000080:3.0:1789121183.457132:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83108c7 00000100:00080000:3.0:1789121183.457153:0:21438:0:(import.c:65:import_set_state_nolock()) ffff946782ae9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789121183.457195:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946783e8c800): rc 0 00000020:00000080:3.0:1789121183.457198:0:21438:0:(genops.c:885:class_export_put()) final put ffff946783e8c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789121183.457206:0:21438:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9468afd57800), last request at 1789121178 00000020:00000080:3.0:1789121183.457210:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310769 00000100:00080000:3.0:1789121183.457214:0:21438:0:(import.c:65:import_set_state_nolock()) ffff9468afd51000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789121183.457224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783e8c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789121183.457263:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782ae9800 for lustre-MDT0000 00000020:00080000:3.0:1789121183.457275:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468afd57800): rc 0 00000020:00000080:3.0:1789121183.457277:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afd57800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789121183.457283:0:21438:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9468c081c800), last request at 1789121103 00000020:00000080:3.0:1789121183.457286:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83106ba 00000100:00080000:3.0:1789121183.457290:0:21438:0:(import.c:65:import_set_state_nolock()) ffff9468c0819800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789121183.457297:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd57800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789121183.457316:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afd51000 for lustre-MDT0000 00000020:00080000:3.0:1789121183.457326:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468c081c800): rc 0 00000020:00000080:3.0:1789121183.457328:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468c081c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789121183.457335:0:21438:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9468c191c800), last request at 1789121103 00000020:00000080:3.0:1789121183.457338:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831065f 00000100:00080000:3.0:1789121183.457342:0:21438:0:(import.c:65:import_set_state_nolock()) ffff9468c081d800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789121183.457349:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c081c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789121183.457375:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c0819800 for lustre-MDT0000 00000001:00000004:3.0:1789121183.457385:0:21438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1789121183.457461:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468c191c800): rc 0 00000004:00000080:3.0:1789121183.457467:0:21438:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa04ac7f2bae0 00000100:00080000:3.0:1789121183.457485:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789121183.457488:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121183.458329:0:21438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789121183.458361:0:21438:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789121183.458515:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789121183.458519:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1789121183.458532:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789121183.458597:0:21438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789121183.458606:0:21438:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789121183.458612:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789121183.458615:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1789121183.458624:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789121183.458684:0:21438:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789121183.458693:0:21438:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789121183.458729:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94678285ced8) has no exports 00010000:00010000:1.0:1789121183.459081:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121183.459091:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.459101:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121183.459105:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.459116:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121183.459134:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121183.459141:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789121183.459144:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789121183.459147:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789121183.459175:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.459182:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789121183.459379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970741120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121183.459439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121183.459724:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:3646:x1876028970740608:12345-0@lo:103:ldlm_bl.0 Request processed in 2926us (3135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.459798:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121183.459848:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741120 00000100:00100000:2.0:1789121183.459854:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741120 00000100:00100000:2.0:1789121183.459963:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121183.459973:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:3647:x1876028970741120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121183.459997:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121183.460013:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54600/0xb74d2367a83104e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83104de expref: 20 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121183.460027:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121183.460063:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:3647:x1876028970741120:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.460194:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789121183.460627:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970740608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121183.460732:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121183.460844:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740736:0@lo:39:umount.0 00000100:00100000:0.0:1789121183.460992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121183.461022:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740864:0@lo:9:umount.0 00000100:00100000:0.0:1789121183.461050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121183.461215:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740992:0@lo:9:umount.0 00000100:00100000:0.0:1789121183.461245:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121183.461284:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740736 00000100:00100000:0.0:1789121183.461290:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740736 00000100:00100000:0.0:1789121183.461328:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789121183.461336:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970740736:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789121183.461365:0:18598:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83106e4 00000100:00080000:0.0:1789121183.461374:0:18598:0:(import.c:65:import_set_state_nolock()) ffff9468afd4b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121183.461398:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789121183.461555:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1876028970740736:12345-0@lo:39:umount.0 Request processed in 219us (563us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789121183.461564:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789121183.462345:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740864 00000100:00100000:2.0:1789121183.462353:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740864 00000100:00100000:2.0:1789121183.462395:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970740992 00000100:00100000:2.0:1789121183.462398:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970740992 00000100:00100000:2.0:1789121183.462421:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789121183.462430:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970740864:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789121183.462450:0:19368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83107af 00000100:00080000:2.0:1789121183.462459:0:19368:0:(import.c:65:import_set_state_nolock()) ffff9468afd55800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121183.462494:0:19368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789121183.462601:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1876028970740864:12345-0@lo:9:umount.0 Request processed in 173us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.462618:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789121183.462632:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789121183.462638:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970740992:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789121183.462651:0:19368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310906 00000100:00080000:2.0:1789121183.462657:0:19368:0:(import.c:65:import_set_state_nolock()) ffff946783950800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121183.462674:0:19368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1789121183.462876:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.463441:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.463472:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.463474:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.463476:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121183.464008:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121183.464015:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121183.464203:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970741120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121183.464278:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789121183.464305:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789121183.464312:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740736:0@lo:39:umount.0 00000100:00080000:1.0:1789121183.464325:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789121183.464344:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789121183.464346:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789121183.464349:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740864:0@lo:9:umount.0 00000100:00100000:2.0:1789121183.464454:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1876028970740992:12345-0@lo:9:umount.0 Request processed in 1814us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.464463:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789121183.464672:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789121183.464688:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789121183.464690:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789121183.464693:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970740992:0@lo:9:umount.0 00000001:00100000:3.0:1789121183.467336:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789121183.467346:0:17834:0:(genops.c:885:class_export_put()) final put ffff9468c191c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789121183.467368:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00080000:3.0:1789121183.467377:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1789121183.467381:0:17834:0:(genops.c:885:class_export_put()) final put ffff94678297d800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00100000:3.0:1789121183.467385:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000001:00080000:3.0:1789121183.467390:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1789121183.467394:0:17834:0:(genops.c:885:class_export_put()) final put ffff946782aec000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:2.0:1789121183.467433:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789121183.467480:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff94678297d800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 for lustre-MDT0000 00000020:00000080:2.0:1789121183.467504:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aec000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 for lustre-MDT0000 00000020:00000080:2.0:1789121183.467543:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c081d800 for lustre-MDT0000 00000020:00000080:2.0:1789121183.467548:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94678297e800 for lustre-MDT0000 00000020:00000080:2.0:1789121183.467550:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afd4b800 for lustre-MDT0000 00000001:00100000:2.0:1789121183.469082:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789121183.469091:0:19362:0:(genops.c:885:class_export_put()) final put ffff9468afd54000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789121183.469111:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:2.0:1789121183.469114:0:19362:0:(genops.c:885:class_export_put()) final put ffff9468c073f000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:2.0:1789121183.469141:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd54000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789121183.469187:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c073f000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 for lustre-OST0000 00000020:00000080:2.0:1789121183.469205:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afd55800 for lustre-OST0000 00000020:00000080:2.0:1789121183.469209:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c073c800 for lustre-OST0000 00000001:00100000:1.0:1789121183.471547:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789121183.471563:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789121183.471569:0:18590:0:(genops.c:885:class_export_put()) final put ffff946782aea800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789121183.471622:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00080000:1.0:1789121183.471629:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789121183.471631:0:18590:0:(genops.c:885:class_export_put()) final put ffff9468c0784800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000020:00000080:3.0:1789121183.471653:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789121183.471714:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afd4b000 for lustre-MDT0001 00000020:00080000:2.0:1789121183.472325:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff94678285ced8) has no exports 00000001:00100000:1.0:1789121183.475514:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000001:00080000:1.0:1789121183.475528:0:18590:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789121183.475533:0:18590:0:(genops.c:885:class_export_put()) final put ffff9468afd4d000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000020:00000080:1.0:1789121183.475553:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c0784800/0d1c643e-f8d1-4998-bc1e-8baa38374a62 for lustre-MDT0001 00000020:00000080:1.0:1789121183.475607:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd4d000/7f977f21-a57c-43c4-b0be-1d901bfa40b7 for lustre-MDT0001 00000020:00000080:1.0:1789121183.475630:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c0782800 for lustre-MDT0001 00000020:00000080:1.0:1789121183.475652:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c0738800 for lustre-MDT0001 00000020:00000080:2.0:1789121183.532410:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310539 00000020:00000080:2.0:1789121183.532427:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a08a1800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789121183.532464:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789121183.532533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a1800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789121183.533254:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121183.533265:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789121183.533269:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9468afc79a48) has no exports 00000020:00000080:3.0:1789121183.533591:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310532 00000020:00000080:3.0:1789121183.533599:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a0882000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121183.533661:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a0882000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789121183.533730:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.534272:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789121183.534278:0:21438:0:(genops.c:885:class_export_put()) final put ffff94689df27000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789121183.534281:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff94689df27000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789121183.534291:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789121183.534426:0:21438:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884ea3180 - data ffff9468ab306948/ffff9467822ea000 00000020:01000000:3.0:1789121183.534574:0:21438:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884131b40 - data ffff9468ab15bca8/ffff9468bb5e7000 00000001:00000004:2.0:1789121183.571188:0:21438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:2.0:1789121183.639020:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121183.639048:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970741248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789121183.639301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121183.639399:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741248 00000100:00100000:3.0:1789121183.639407:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741248 00000100:00100000:3.0:1789121183.639478:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789121183.639487:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970741248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789121183.639519:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121183.639570:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970741248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121183.639577:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789121183.639628:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970741248:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789121183.639756:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121183.641080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970741376:0@lo:400:kworker.0 00000100:00100000:3.0:1789121183.641152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121183.641343:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741376 00000100:00100000:2.0:1789121183.641349:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741376 00000100:00100000:2.0:1789121183.641386:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789121183.641393:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876028970741376:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789121183.641400:0:17860:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789121183.642442:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970741632:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.642489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.642517:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970742144:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.642543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.642563:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789121183.642569:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970741504:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.642592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.642608:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970742016:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.642626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.642653:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741632 00000100:00100000:1.0:1789121183.642658:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741632 00000100:00100000:1.0:1789121183.642687:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742144 00000100:00100000:1.0:1789121183.642689:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742144 00000100:00100000:1.0:1789121183.642716:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742016 00000100:00100000:1.0:1789121183.642719:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742016 00000100:00100000:1.0:1789121183.642731:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789121183.642752:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970742144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.642796:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970742144:12345-0@lo:400:kworker.0 Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121183.642803:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789121183.642818:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789121183.642838:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876028970741632:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789121183.642843:0:17856:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789121183.642865:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876028970741632:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789121183.642894:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789121183.642906:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789121183.642910:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876028970742016:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789121183.642915:0:17856:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789121183.642937:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876028970742016:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789121183.642942:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789121183.642961:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741504 00000100:00100000:1.0:1789121183.642964:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741504 00000100:00100000:1.0:1789121183.643001:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121183.643009:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970741504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.643037:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970741504:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121183.643043:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121183.643070:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970741760:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.643093:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.643112:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121183.643118:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970741888:0@lo:400:kworker.0 00000100:00100000:2.0:1789121183.643242:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1876028970741376:12345-0@lo:400:kworker.0 Request processed in 1847us (2088us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121183.643251:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789121183.643463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789121183.643501:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789121183.643506:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121183.643535:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970741504:0@lo:400:kworker.0 00000100:00080000:1.0:1789121183.643546:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789121183.643550:0:3647:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789121183.643554:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789121183.644059:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741760 00000100:00100000:2.0:1789121183.644065:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741760 00000100:00100000:2.0:1789121183.644092:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970741888 00000100:00100000:2.0:1789121183.644096:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970741888 00000100:00100000:2.0:1789121183.644139:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789121183.644147:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970741888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121183.644194:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970741888:12345-0@lo:400:kworker.0 Request processed in 48us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121183.644202:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789121183.644215:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789121183.644218:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876028970741760:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789121183.644223:0:17854:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789121183.644248:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876028970741760:12345-0@lo:400:kworker.0 Request processed in 27us (1153us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121183.644265:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789121183.647271:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789121183.647279:0:3645:0:(import.c:65:import_set_state_nolock()) ffff946783dec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789121183.647284:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789121183.647290:0:3645:0:(import.c:65:import_set_state_nolock()) ffff946783dec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121183.647312:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:3.0:1789121183.647321:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff946783dec000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121183.647357:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946891482940 x1876028970742272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121183.647398:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970741376:0@lo:400:kworker.0 00000100:00100000:2.0:1789121183.647532:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970742272:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789121183.647605:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121183.647717:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742272 00000100:00100000:3.0:1789121183.647724:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742272 00000100:00100000:3.0:1789121183.647777:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789121183.647785:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970742272:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789121183.647803:0:17859:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1789121183.650075:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789121183.652510:0:3647:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121183.652521:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 587 00000100:00080000:1.0:1789121183.652531:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946782978800 using connection 192.168.202.132@tcp/0@lo 00010000:00080000:1.0:1789121183.652601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748000 x1876028970741888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121183.652617:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970741888:0@lo:400:kworker.0 00000100:00080000:1.0:1789121183.652631:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789121183.652636:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789121183.652639:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789121183.652643:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121183.652646:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 572 00000100:00080000:1.0:1789121183.652650:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9468afc68800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121183.652684:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b1a40 x1876028970742400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121183.652726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970741760:0@lo:400:kworker.0 00000100:00100000:2.0:1789121183.652847:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970742400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789121183.652919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121183.652986:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742400 00000100:00100000:2.0:1789121183.652991:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742400 00000100:00100000:2.0:1789121183.653029:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789121183.653037:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970742400:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789121183.653052:0:17854:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789121183.653093:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970742400:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55us (173us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121183.653099:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789121183.653135:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121183.653140:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789121183.653143:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970742400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789121183.653386:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b2580 x1876028970742528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121183.653405:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970742016:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.653415:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970742528:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789121183.653441:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.653472:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742528 00000100:00100000:1.0:1789121183.653476:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742528 00000100:00100000:1.0:1789121183.653507:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789121183.653510:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876028970742528:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789121183.653519:0:19756:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789121183.653551:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876028970742528:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 39us (109us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789121183.653556:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789121183.653578:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121183.653582:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121183.653584:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970742528:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789121183.653603:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789121183.653606:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9468914ac800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789121183.653610:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789121183.653613:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9468914ac800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121183.653616:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:1.0:1789121183.653621:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9468914ac800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121183.653633:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b2580 x1876028970742656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121183.653647:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970741632:0@lo:400:kworker.0 00000100:00100000:1.0:1789121183.653657:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970742656:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789121183.653678:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121183.653701:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742656 00000100:00100000:1.0:1789121183.653704:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742656 00000100:00100000:1.0:1789121183.653725:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789121183.653729:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970742656:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789121183.654233:0:19755:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789121183.654272:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970742656:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 541us (592us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789121183.654278:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789121183.654311:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468914ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121183.654315:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121183.654317:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970742656:0@lo:38:ptlrpcd_00_03.0 00010000:00080000:1.0:1789121183.654342:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf7483c0 x1876028970742144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121183.654352:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970742144:0@lo:400:kworker.0 00000100:00080000:1.0:1789121183.662874:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121183.662954:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789121183.662968:0:21438:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff946891482d00 x1876028970740736/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789121193 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121183.663010:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789121183.669374:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789121183.669384:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789121183.669405:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789121183.669408:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789121183.670118:0:17878:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789121183.670136:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1789121183.670148:0:17878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789121183.670732:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789121183.670748:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1789121183.670763:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789121183.670765:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789121183.672441:0:17880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789121183.672447:0:17880:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1789121183.672457:0:17880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1789121183.677445:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970742272:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29652us (29832us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789121183.677460:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789121183.677584:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783dec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121183.677591:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121183.677596:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970742272:0@lo:38:ptlrpcd_00_01.0 00000020:00000080:1.0:1789121183.678062:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310501 00000020:00000080:1.0:1789121183.678073:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe5c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789121183.678224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789121183.679324:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310516 00000020:00000080:2.0:1789121183.679333:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe5c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121183.679349:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789121183.679354:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121183.679367:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121183.679371:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff946782858000) has no exports 00000020:00000080:1.0:1789121183.679427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1789121183.679652:0:21438:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789121183.679660:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310578 00000020:00000080:2.0:1789121183.679664:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe5f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121183.679677:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789121183.679681:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121183.679685:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121183.679688:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff946782859a48) has no exports 00000020:00000080:2.0:1789121183.679693:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310571 00000020:00000080:2.0:1789121183.679695:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a08a9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121183.679740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789121183.680363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789121183.683572:0:21438:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789121183.683581:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789121183.683586:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1789121183.683593:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121183.683596:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121183.683646:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121183.683656:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789121183.683665:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310563 00000020:00000080:2.0:1789121183.683675:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a08a0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121183.683682:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789121183.683691:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121183.683695:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121183.683699:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9467821eb490) has no exports 00000020:00000080:2.0:1789121183.683706:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831055c 00000020:00000080:2.0:1789121183.683709:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a08a4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121183.683816:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468a08a9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789121183.683845:0:37:0:(genops.c:885:class_export_put()) final put ffff9468a08a4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121183.683848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789121183.683854:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121183.683945:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789121183.683950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789121183.685506:0:21438:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789121183.685513:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789121183.685517:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1789121183.685523:0:21438:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121183.685525:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121183.685569:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121183.685587:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789121183.685600:0:21438:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789121183.685607:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831054e 00000020:00000080:2.0:1789121183.685615:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468a08aa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121183.685620:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789121183.685624:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121183.685629:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121183.685632:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff946783ca0000) has no exports 00000020:00000080:2.0:1789121183.685639:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310547 00000020:00000080:2.0:1789121183.685642:0:21438:0:(genops.c:885:class_export_put()) final put ffff946888742000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121183.685902:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468a08a2000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789121183.685910:0:37:0:(genops.c:885:class_export_put()) final put ffff9468a08a8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121183.685913:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789121183.685919:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121183.686011:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08aa000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789121183.686016:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946888742000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789121183.689427:0:21438:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789121183.689437:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789121183.689442:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789121183.689450:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789121183.689510:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.689522:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789121183.689558:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.689561:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789121183.689568:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe5e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789121183.689573:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789121183.689581:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789121183.689698:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831051d 00000020:00000080:3.0:1789121183.689706:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe59800/lustre-MDD0000_UUID 00000020:01000000:3.0:1789121183.689723:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789121183.689728:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121183.689734:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1789121183.689843:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946888741000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789121183.689851:0:37:0:(genops.c:885:class_export_put()) final put ffff9468a08a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121183.689854:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a08a0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789121183.689860:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121183.689926:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe59800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:3.0:1789121183.690195:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff94678285b490) has no exports 00000020:00000080:3.0:1789121183.690217:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.690221:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789121183.690224:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe5b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789121183.690227:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789121183.690230:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789121183.690264:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310524 00000020:00000080:3.0:1789121183.690269:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe58000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789121183.690283:0:21438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946784ac0800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789121183.690286:0:21438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784ac0800 3 00000020:01000004:3.0:1789121183.690289:0:21438:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946784ac0800 from lustre-MDT0000 00000020:00000080:3.0:1789121183.690307:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.690311:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789121183.690313:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468afe59000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789121183.690315:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe59000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789121183.690321:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789121183.690345:0:21438:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789121183.690348:0:21438:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789121183.690351:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789121183.690353:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121183.690356:0:21438:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789121183.690362:0:21438:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff946784a67800 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121183.690367:0:21438:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff946783ca1a48) has exports, disconnecting them 00000020:00080000:3.0:1789121183.690371:0:21438:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff946784a67800), last request at 1789121087 00000020:00000080:3.0:1789121183.690387:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83104c9 00000020:00010000:3.0:1789121183.690392:0:21438:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946784a67800: total 1 00000100:00080000:3.0:1789121183.690397:0:21438:0:(import.c:65:import_set_state_nolock()) ffff946784a60000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789121183.690408:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946784a67800): rc 0 00000020:00080000:3.0:1789121183.690411:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff946783ca1a48) has no exports 00000100:00100000:3.0:1789121183.690487:0:17849:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff94689e00d000:17849] 2 exiting: rc = 0 00000020:00010000:1.0:1789121183.690740:0:17842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946784a67800: total 1 00010000:00010000:1.0:1789121183.690774:0:17842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946784a67800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789121183.690804:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54200/0xb74d2367a83105e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83105e1 expref: 14 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690857:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3a00/0xb74d2367a8310754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a831074d expref: 13 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690873:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55a00/0xb74d2367a8310a80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310a79 expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690882:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e22200/0xb74d2367a83106a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a831069e expref: 11 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690892:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55400/0xb74d2367a83105f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83105ef expref: 10 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690904:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990800/0xb74d2367a83108b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83108ab expref: 9 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690913:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217de00/0xb74d2367a83104d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83104d0 expref: 8 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690923:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1600/0xb74d2367a8310a72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310a6b expref: 7 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690932:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0600/0xb74d2367a8310a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310a87 expref: 6 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690942:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3b600/0xb74d2367a8310604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83105fd expref: 5 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690953:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e22400/0xb74d2367a83108f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a83108ea expref: 4 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.690991:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3bc00/0xb74d2367a831072a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310723 expref: 3 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.691002:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23800/0xb74d2367a8310888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a8310881 expref: 2 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121183.691013:0:17842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946784a67800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789121183.691028:0:17842:0:(genops.c:885:class_export_put()) final put ffff946784a67800/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee 00010000:00010000:1.0:1789121183.691035:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.691037:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121183.691039:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789121183.691048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe58000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789121183.691054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946784a67800/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee for MGS 00000020:00000080:1.0:1789121183.691082:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946784a60000 for MGS 00000100:00100000:1.0:1789121183.692033:0:17847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9467821a5800:17847] 0 exiting: rc = 1 00000100:00100000:3.0:1789121183.693547:0:17848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff946784901200:17848] 1 exiting: rc = 0 00000100:00100000:1.0:1789121183.693693:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693701:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693707:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693713:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693719:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693724:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693730:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693735:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693741:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693746:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693751:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693756:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693760:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693765:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693769:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693786:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693805:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693812:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693818:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693843:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693849:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693854:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693859:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693864:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693869:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693873:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693878:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693883:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693888:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693893:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693899:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693905:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693910:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693916:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693921:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693927:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693933:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693937:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693942:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693947:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693952:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693957:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693963:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693969:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693987:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693993:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.693998:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694004:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694010:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694015:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694029:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694036:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694042:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694047:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694052:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694057:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694063:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694640:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694650:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694655:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694660:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694666:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694671:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121183.694676:0:21438:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789121183.699447:0:21438:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884ea3420 - data ffff9468ab18d000/ffff9467822ea800 00000020:01000000:1.0:1789121183.699584:0:21438:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884131900 - data ffff946888fcd870/ffff946887b7d400 00000020:00000080:1.0:1789121183.700281:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83104ad 00000020:00000080:1.0:1789121183.700292:0:21438:0:(genops.c:885:class_export_put()) final put ffff946888740800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789121183.700310:0:21438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946784ac0800 from MGS, refs=2 00000020:01000004:1.0:1789121183.700313:0:21438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784ac0800 2 00000020:01000004:1.0:1789121183.700317:0:21438:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946784ac0800 from MGS 00000020:00000080:1.0:1789121183.700339:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121183.700346:0:21438:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789121183.700349:0:21438:0:(genops.c:885:class_export_put()) final put ffff946888746000/MGS 00000020:00000080:1.0:1789121183.700352:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff946888746000/MGS for MGS 00000020:01000000:1.0:1789121183.700358:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789121183.700429:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789121183.700433:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121183.700439:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789121183.700447:0:21438:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff946783ded800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789121183.700453:0:21438:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff946783c7ced8) has exports, disconnecting them 00000020:00080000:1.0:1789121183.700458:0:21438:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff946783ded800), last request at 1789121088 00000020:00000080:1.0:1789121183.700463:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83105b0 00000020:00080000:1.0:1789121183.700486:0:21438:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946783ded800): rc 0 00000020:00000080:1.0:1789121183.700491:0:21438:0:(genops.c:885:class_export_put()) final put ffff946783ded800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789121183.701167:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946888740800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789121183.701180:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946783ded800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789121183.701865:0:21438:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789121183.701870:0:21438:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121183.701874:0:21438:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789121183.701890:0:21438:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789121183.701914:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783de9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789121183.702099:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.702106:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789121183.702112:0:21438:0:(genops.c:885:class_export_put()) final put ffff9468919c1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789121183.702115:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff9468919c1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789121183.702128:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789121183.702213:0:21438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784ac0800 1 00000020:00000080:3.0:1789121183.702220:0:21438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831049f 00000020:00000080:3.0:1789121183.702227:0:21438:0:(genops.c:885:class_export_put()) final put ffff946888745800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789121183.702237:0:21438:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789121183.702246:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946888745800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789121183.702256:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121183.702260:0:21438:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789121183.702263:0:21438:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9468afc7ced8) has no exports 00000020:00000080:3.0:1789121183.865759:0:21438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121183.865775:0:21438:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789121183.865781:0:21438:0:(genops.c:885:class_export_put()) final put ffff946784ac6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789121183.865787:0:21438:0:(genops.c:844:class_export_destroy()) destroying export ffff946784ac6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789121183.865802:0:21438:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789121183.865996:0:21438:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff946784ac4800 00000020:02000400:3.0:1789121183.866061:0:21438:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789121184.210119:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121185.234122:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121185.426620:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789121185.698989:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121185.699023:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970742784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121185.699094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121185.699782:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742784 00000100:00100000:2.0:1789121185.699793:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742784 00000100:00100000:2.0:1789121185.699890:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789121185.699901:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970742784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121185.699933:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121185.699998:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970742784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121185.700006:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789121185.701267:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121185.701327:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970742784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789121186.267800:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121187.287992:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789121188.258996:0:21638:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789121188.288666:0:21638:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789121188.288746:0:21638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.288765:0:21638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.288774:0:21638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.288784:0:21638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.288812:0:21638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789121188.288846:0:21638:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789121188.288878:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121188.288883:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121188.288890:0:21638:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121188.288899:0:21638:0:(import.c:65:import_set_state_nolock()) ffff9468914ac800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789121188.288905:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121188.288907:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789121188.288911:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789121188.288945:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121188.288956:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121188.288965:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121188.288971:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121188.288981:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121188.288990:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121188.289016:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121188.289019:0:17843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789121188.289022:0:17843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789121188.289142:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121188.289150:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121188.289185:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121188.289192:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121188.289208:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121188.289211:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121188.289213:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121188.289240:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970742912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121188.289586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121188.289698:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970742912 00000100:00100000:2.0:1789121188.289708:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970742912 00000100:00100000:2.0:1789121188.289758:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121188.289770:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876028970742912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789121188.289778:0:17839:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121188 with bad export cookie 13208252210257921225 00010000:00010000:3.0:1789121188.289872:0:21638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289898:0:21638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289905:0:21638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289912:0:21638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289947:0:21638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121188.289954:0:21638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289961:0:21638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289967:0:21638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289974:0:21638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.289987:0:21638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789121188.289993:0:21638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290001:0:21638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290020:0:21638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290028:0:21638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290036:0:21638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789121188.290042:0:21638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290049:0:21638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290057:0:21638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290064:0:21638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121188.290070:0:21638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789121188.290073:0:21638:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789121188.290099:0:21638:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789121188.290103:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789121188.290108:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121188.290114:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789121188.290120:0:21638:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff946783957000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121188.290126:0:21638:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9467838ea800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121188.290131:0:21638:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9468afc7b490) has exports, disconnecting them 00000020:00080000:3.0:1789121188.290142:0:21638:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff946783957000), last request at 1789121183 00000020:00000080:3.0:1789121188.290152:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83108dc 00000100:00080000:3.0:1789121188.290171:0:21638:0:(import.c:65:import_set_state_nolock()) ffff946783954800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789121188.290228:0:21638:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946783957000): rc 0 00000020:00000080:3.0:1789121188.290231:0:21638:0:(genops.c:885:class_export_put()) final put ffff946783957000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789121188.290244:0:21638:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9467838ea800), last request at 1789121183 00000020:00000080:3.0:1789121188.290247:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831077e 00000100:00080000:3.0:1789121188.290254:0:21638:0:(import.c:65:import_set_state_nolock()) ffff9467838ef000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789121188.290261:0:21638:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9467838ea800): rc 0 00000020:00000080:3.0:1789121188.290263:0:21638:0:(genops.c:885:class_export_put()) final put ffff9467838ea800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789121188.290271:0:21638:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa04ac19f3ae0 00000100:00080000:3.0:1789121188.290296:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121188.290299:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121188.291388:0:21638:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121188.291398:0:21638:0:(import.c:65:import_set_state_nolock()) ffff946783dec000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1789121188.294769:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789121188.294787:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.294801:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121188.294806:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.294835:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121188.294844:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121188.294892:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121188.294896:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789121188.294899:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789121188.294967:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.294975:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121188.295009:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295017:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295034:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789121188.295040:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295045:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121188.295048:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295054:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121188.295060:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121188.295065:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121188.295067:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789121188.295076:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789121188.295092:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295098:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121188.295105:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295111:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295126:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121188.295131:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295138:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121188.295141:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295149:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121188.295157:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121188.295163:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789121188.295165:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789121188.295167:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789121188.295182:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295189:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121188.295221:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295229:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295240:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121188.295245:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295252:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121188.295255:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295263:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121188.295269:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121188.295274:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121188.295276:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789121188.295277:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789121188.295290:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295296:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121188.295301:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295307:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121188.295333:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121188.295335:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121188.295337:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121188.295368:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970743040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121188.295470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121188.295550:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121188.295557:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970743168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121188.295584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121188.295621:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743040 00000100:00100000:0.0:1789121188.295630:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743040 00000100:00100000:0.0:1789121188.295664:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743168 00000100:00100000:0.0:1789121188.295666:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743168 00000100:00100000:0.0:1789121188.295680:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121188.295689:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1876028970743040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789121188.295697:0:17840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121188 with bad export cookie 13208252210257921225 00000100:00100000:0.0:1789121188.295744:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1876028970743040:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (274us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121188.295752:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121188.295785:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789121188.295790:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1876028970743168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789121188.295795:0:17840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121188 with bad export cookie 13208252210257921225 00000100:00100000:0.0:1789121188.295845:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1876028970743168:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (236us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121188.295851:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789121188.295874:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970743296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121188.295907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121188.295926:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121188.295945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970743424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121188.295967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121188.295991:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743296 00000100:00100000:0.0:1789121188.295994:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743296 00000100:00100000:0.0:1789121188.296008:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743424 00000100:00100000:0.0:1789121188.296010:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743424 00000100:00100000:0.0:1789121188.296018:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789121188.296023:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876028970743296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789121188.296027:0:17841:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121188 with bad export cookie 13208252210257921225 00000100:00100000:0.0:1789121188.296058:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876028970743296:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (149us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121188.296064:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789121188.296074:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789121188.296078:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876028970743424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789121188.296082:0:17841:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121188 with bad export cookie 13208252210257921225 00000100:00100000:0.0:1789121188.296106:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1876028970743424:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (137us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121188.296112:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789121188.296144:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789121188.296150:0:3644:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789121188.296154:0:3644:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789121188.296787:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789121188.296794:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789121188.296814:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789121188.296965:0:21638:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789121188.296991:0:21638:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789121188.297013:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789121188.297016:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789121188.297025:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789121188.297091:0:21638:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789121188.297102:0:21638:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789121188.297145:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9468afc7b490) has no exports 00010000:00010000:3.0:1789121188.305144:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789121188.305371:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946783957000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789121188.305451:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9467838ea800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789121188.305479:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783954800 for lustre-MDT0001 00000020:00000080:1.0:1789121188.305485:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467838ef000 for lustre-MDT0001 00000100:00100000:1.0:1789121188.305527:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970743552:0@lo:9:umount.0 00000100:00100000:1.0:1789121188.305635:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121188.305689:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970743680:0@lo:9:umount.0 00000100:00100000:1.0:1789121188.305718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789121188.305801:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1789121188.307424:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743552 00000100:00100000:2.0:1789121188.307436:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743552 00000100:00100000:2.0:1789121188.307525:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970743680 00000100:00100000:2.0:1789121188.307529:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970743680 00000100:00100000:2.0:1789121188.307560:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121188.307570:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876028970743552:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789121188.307619:0:19367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83107a8 00000100:00080000:2.0:1789121188.307630:0:19367:0:(import.c:65:import_set_state_nolock()) ffff9468afc6f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121188.307678:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789121188.308399:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876028970743552:12345-0@lo:9:umount.0 Request processed in 827us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121188.308409:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121188.308428:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789121188.308436:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876028970743680:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789121188.308451:0:19367:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831090d 00000100:00080000:2.0:1789121188.308457:0:19367:0:(import.c:65:import_set_state_nolock()) ffff946783950000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121188.308484:0:19367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789121188.308564:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876028970743680:12345-0@lo:9:umount.0 Request processed in 129us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121188.308571:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789121188.308600:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789121188.308604:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789121188.308648:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789121188.308664:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789121188.308666:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.308669:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970743552:0@lo:9:umount.0 00000100:00080000:2.0:1789121188.308682:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789121188.308690:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789121188.308691:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.308693:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970743680:0@lo:9:umount.0 00010000:00010000:2.0:1789121188.308731:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121188.308737:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121188.310212:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1876028970742912:12345-0@lo:103:ldlm_bl.0 Request processed in 20439us (20624us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121188.310241:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789121188.310308:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789121188.343378:0:3644:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.132@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789121188.343387:0:3644:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789121188.343402:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebd2c0 x1876028970742912/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121188.343527:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848fb0c0 x1876028970743040/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121188.343537:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848f9e00 x1876028970743168/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121188.343545:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848f9680 x1876028970743296/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121188.343555:0:3644:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848f92c0 x1876028970743424/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789121188.343568:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789121188.343573:0:3644:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789121188.343575:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789121188.347550:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff946888742800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789121188.347649:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970743040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121188.347695:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970743168:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789121188.349574:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff946888742800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789121188.349609:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970742912:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789121188.352530:0:3644:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121188.352551:0:3644:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1789121188.352566:0:3644:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946888742800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121188.352701:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848fb840 x1876028970743808/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121188.352785:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970743808:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1789121188.352911:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970743808 offset 0 length 520: 4 00000100:00100000:0.0:1789121188.353109:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970743296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121188.353144:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121188.353149:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970743424:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789121188.361750:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9468afc7b490) has no exports 00000020:01000000:0.0:1789121188.449814:0:21638:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884ea3960 - data ffff9468822ebaf8/ffff9468c158ac00 00000020:01000000:0.0:1789121188.458300:0:21638:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94688631ade0 - data ffff9468ab293ca8/ffff9468c158b800 00000001:00000004:0.0:1789121188.467740:0:21638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789121188.536966:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789121188.536979:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789121188.536989:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789121188.541118:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789121188.541131:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789121188.541199:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.541204:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789121188.542567:0:18599:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789121188.542575:0:18599:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789121188.542590:0:18599:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789121188.544173:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789121188.544184:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789121188.544207:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.544210:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789121188.550019:0:18601:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789121188.550033:0:18601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789121188.550095:0:18601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789121188.554339:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310612 00000020:00000080:2.0:1789121188.554355:0:21638:0:(genops.c:885:class_export_put()) final put ffff946783de9000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789121188.555405:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310627 00000020:00000080:2.0:1789121188.555415:0:21638:0:(genops.c:885:class_export_put()) final put ffff946891f06800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789121188.555422:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789121188.555430:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121188.555442:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121188.555448:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9468afc78000) has no exports 00000020:00000080:1.0:1789121188.555651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783de9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789121188.555667:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946891f06800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789121188.556223:0:21638:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789121188.556307:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831067b 00000020:00000080:2.0:1789121188.556317:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468a0872800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789121188.556334:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789121188.556343:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121188.556370:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121188.556373:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9467821eced8) has no exports 00000020:00000080:2.0:1789121188.556382:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310674 00000020:00000080:2.0:1789121188.556387:0:21638:0:(genops.c:885:class_export_put()) final put ffff946890f60800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789121188.556617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a0872800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789121188.556626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946890f60800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789121188.557392:0:21638:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789121188.557398:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789121188.557403:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789121188.557411:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.557413:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121188.557459:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121188.557465:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121188.557471:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310666 00000020:00000080:2.0:1789121188.557478:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468914a8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789121188.557481:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789121188.557485:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121188.557487:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121188.557491:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9468ab901a48) has no exports 00000020:00000080:2.0:1789121188.557497:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310658 00000020:00000080:2.0:1789121188.557500:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468bf672800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789121188.557669:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946890f63000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789121188.557677:0:37:0:(genops.c:885:class_export_put()) final put ffff9468914ad000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789121188.557680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468914ad000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789121188.557686:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789121188.557802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468914a8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789121188.557808:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf672800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789121188.558655:0:21638:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789121188.558661:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789121188.558665:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789121188.558672:0:21638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121188.558674:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121188.558724:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121188.558731:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789121188.558749:0:21638:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789121188.558756:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831064a 00000020:00000080:2.0:1789121188.558763:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468bf676800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789121188.558769:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789121188.558773:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121188.558777:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121188.558790:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff946783c78000) has no exports 00000020:00000080:2.0:1789121188.558796:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310643 00000020:00000080:2.0:1789121188.558799:0:21638:0:(genops.c:885:class_export_put()) final put ffff946783dea800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789121188.558980:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468bf672000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789121188.558989:0:37:0:(genops.c:885:class_export_put()) final put ffff9468bf673800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789121188.558992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf673800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789121188.558999:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789121188.563196:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf676800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789121188.563215:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783dea800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789121188.572700:0:21638:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789121188.572756:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121188.572762:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789121188.572772:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789121188.572960:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121188.572976:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789121188.572999:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783dec000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789121188.573013:0:37:0:(genops.c:885:class_export_put()) final put ffff946783e8b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789121188.573018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783e8b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789121188.573026:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121188.573223:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121188.573228:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121188.573239:0:21638:0:(genops.c:885:class_export_put()) final put ffff946891399000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789121188.573242:0:21638:0:(genops.c:844:class_export_destroy()) destroying export ffff946891399000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789121188.573251:0:21638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121188.573561:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831062e 00000020:00000080:0.0:1789121188.573571:0:21638:0:(genops.c:885:class_export_put()) final put ffff946891f02800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789121188.573587:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789121188.573592:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121188.573598:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789121188.573603:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9468ab900000) has no exports 00000020:00000080:0.0:1789121188.573628:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121188.573631:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789121188.573637:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310635 00000020:00000080:0.0:1789121188.573641:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468afe5d800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789121188.573650:0:21638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468b9c33800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789121188.573653:0:21638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9c33800 2 00000020:01000004:0.0:1789121188.573657:0:21638:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9468b9c33800 from lustre-MDT0001 00000020:00000080:0.0:1789121188.573675:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121188.573678:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789121188.573680:0:21638:0:(genops.c:885:class_export_put()) final put ffff946783def800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789121188.573683:0:21638:0:(genops.c:844:class_export_destroy()) destroying export ffff946783def800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789121188.573690:0:21638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789121188.573722:0:21638:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789121188.573747:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789121188.573750:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121188.573753:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789121188.573761:0:21638:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9468a0874800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121188.573766:0:21638:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9467821e8000) has exports, disconnecting them 00000020:00080000:0.0:1789121188.573772:0:21638:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9468a0874800), last request at 1789121103 00000020:00000080:0.0:1789121188.573776:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83106b3 00000020:00080000:0.0:1789121188.573788:0:21638:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468a0874800): rc 0 00000020:00000080:0.0:1789121188.573791:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468a0874800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789121188.576043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946891f02800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789121188.576057:0:37:0:(genops.c:885:class_export_put()) final put ffff9468afe5e000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789121188.576060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5e000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789121188.576068:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789121188.576275:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789121188.576287:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a0874800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789121188.623666:0:21638:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789121188.623679:0:21638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121188.623685:0:21638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789121188.623696:0:21638:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789121188.623742:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468914ac800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789121188.624053:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121188.624555:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789121188.624565:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468a0876000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789121188.624570:0:21638:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a0876000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789121188.624586:0:21638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789121188.624688:0:21638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9c33800 1 00000020:00000080:1.0:1789121188.624695:0:21638:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83105da 00000020:00000080:1.0:1789121188.624704:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468840c6000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789121188.624722:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789121188.624735:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff9468840c6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789121188.624747:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121188.624753:0:21638:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789121188.624757:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9467821e9a48) has no exports 00000020:00000080:0.0:1789121188.740269:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121188.740290:0:21638:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789121188.740299:0:21638:0:(genops.c:885:class_export_put()) final put ffff9468b9c33000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789121188.740306:0:21638:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b9c33000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789121188.740324:0:21638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789121188.740481:0:21638:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9468b9c35000 00000020:01000000:0.0:1789121188.740510:0:21638:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789121188.740579:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121188.740585:0:21638:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789121188.740590:0:21638:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff946783ca4ed8) has no exports 00000100:00100000:1.0:1789121188.740943:0:19756:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9468c161b000:19756] 4 exiting: rc = 0 00000100:00100000:2.0:1789121188.741040:0:17856:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9468a3a83000:17856] 2 exiting: rc = 0 00000100:00100000:1.0:1789121188.741101:0:19755:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff946782800000:19755] 3 exiting: rc = 0 00000100:00100000:2.0:1789121188.741126:0:17855:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9468852f8600:17855] 1 exiting: rc = 0 00000100:00100000:1.0:1789121188.741162:0:17854:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9468852f9a00:17854] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.741415:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741426:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741431:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741437:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741443:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741448:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741456:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741462:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741468:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741474:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741480:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741487:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741494:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741584:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741592:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741597:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741603:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741609:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741616:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741623:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741629:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741634:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741641:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741646:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741652:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741659:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741664:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741670:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741675:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741682:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741688:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741693:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741698:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741703:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741729:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741735:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741745:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741751:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741758:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741763:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741769:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741775:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741781:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741787:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741792:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741799:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741806:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741811:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741974:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741981:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741988:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.741995:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742002:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742007:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742014:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742020:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742026:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742032:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742038:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742044:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742050:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742057:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742063:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.742070:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121188.747921:0:17858:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9468c1bc6400:17858] 1 exiting: rc = 0 00000100:00100000:3.0:1789121188.753140:0:17857:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9468a3a83600:17857] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.753346:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753356:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753364:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753370:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753375:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753380:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753385:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753390:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753395:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753400:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753405:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753410:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753415:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753420:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753424:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753430:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753436:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753442:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753447:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753471:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753476:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753482:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753488:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753493:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753505:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753606:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753614:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753619:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753624:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753630:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753635:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753641:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753647:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753653:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753658:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753663:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753668:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753674:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753680:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753686:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753691:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753696:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753701:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753706:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753711:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753717:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753723:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753730:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753735:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753741:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753747:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753752:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753757:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753763:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753777:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753784:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753789:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753795:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753800:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753805:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753811:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753817:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753854:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.753861:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121188.760303:0:18598:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9468c155fc00:18598] 2 exiting: rc = 0 00000100:00100000:2.0:1789121188.760498:0:17860:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9468c190e600:17860] 1 exiting: rc = 0 00000100:00100000:3.0:1789121188.761187:0:17859:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9468c190e800:17859] 0 exiting: rc = 1 00000100:00080000:1.0:1789121188.764885:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121188.764899:0:19798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789121188.764904:0:19798:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121188.764914:0:19798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1789121188.764921:0:19798:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789121188.764941:0:19798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9468afc68800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121188.764994:0:19798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b0000 x1876028970743936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121188.765050:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121188.765054:0:19798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789121188.765056:0:19798:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121188.765060:0:19798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1789121188.765076:0:19798:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789121188.765080:0:19798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946782978800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121188.765094:0:19798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b30c0 x1876028970744192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121188.765139:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970744064:0@lo:400:kworker.0 00000400:00000100:1.0:1789121188.765215:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744064 offset 0 length 224: 4 00000100:00100000:1.0:1789121188.765425:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121188.765432:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970744320:0@lo:400:kworker.0 00000400:00000100:1.0:1789121188.765450:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744320 offset 0 length 224: 4 00000100:00100000:1.0:1789121188.765499:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765509:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765526:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765533:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765540:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765558:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765565:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765572:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765579:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765586:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765592:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765600:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765607:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765614:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765621:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765627:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765634:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765655:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765662:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765669:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765676:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765689:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765696:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765702:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765712:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765722:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765729:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765737:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765746:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765776:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765783:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765790:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765797:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765804:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765811:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765817:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765844:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765851:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765857:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765863:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765870:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765892:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765899:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765906:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765912:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765919:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765935:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765943:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765950:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765957:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765963:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765970:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.765976:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766030:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766037:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766042:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766064:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766072:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766079:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766087:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766094:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766101:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766108:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.766116:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121188.787947:0:17862:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9468a0416e00:17862] 1 exiting: rc = 0 00000100:00100000:3.0:1789121188.788443:0:17861:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9468a0417000:17861] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.788477:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970743936:0@lo:38:kworker.0 00000400:00000100:0.0:1789121188.788618:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970743936 offset 0 length 520: 4 00000100:00100000:0.0:1789121188.788664:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970744192:0@lo:38:kworker.0 00000400:00000100:0.0:1789121188.788687:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744192 offset 0 length 520: 4 00000001:00100000:0.0:1789121188.797267:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789121188.797281:0:20185:0:(genops.c:885:class_export_put()) final put ffff946783954000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789121188.797318:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789121188.797321:0:20185:0:(genops.c:885:class_export_put()) final put ffff946783955800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789121188.797342:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946783954000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789121188.797406:0:19798:0:(genops.c:844:class_export_destroy()) destroying export ffff946783955800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789121188.797427:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783950000 for lustre-OST0001 00000020:00000080:0.0:1789121188.797432:0:19798:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783950800 for lustre-OST0001 00000100:00100000:0.0:1789121188.799107:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799118:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799124:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799130:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799136:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799143:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799149:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799155:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799183:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799189:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799195:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799202:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799207:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799213:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799218:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799225:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799230:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799235:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799242:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799249:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799254:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799259:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799266:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799271:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799277:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799282:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799287:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799292:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799298:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799307:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799314:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799320:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799325:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799331:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799337:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799344:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799349:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799355:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799362:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799367:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799373:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799385:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799390:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799407:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799413:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799419:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799424:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799431:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799436:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799443:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799448:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799454:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799459:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799464:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799470:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799476:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799483:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799488:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799493:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799498:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799504:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799508:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799514:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.799521:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.800286:0:17864:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff946782b81a00:17864] 1 exiting: rc = 0 00000100:00100000:1.0:1789121188.801341:0:17863:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff946782b80a00:17863] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.802040:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802050:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802056:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802133:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802143:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802148:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802154:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802160:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802166:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802171:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802176:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802182:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802188:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802212:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802217:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802224:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802229:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802235:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802241:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802247:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802252:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802257:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802263:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802269:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802275:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802280:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802286:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802292:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802298:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802303:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802308:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802313:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802318:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802324:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802330:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802336:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802342:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802348:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802353:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802358:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802364:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802368:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802373:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802380:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802385:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802390:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802395:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802401:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802417:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802428:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802434:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802443:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802449:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802458:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802467:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802477:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802491:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802506:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802512:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802518:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802532:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802537:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802543:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.802549:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.804618:0:17866:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff946782b80800:17866] 1 exiting: rc = 0 00000100:00100000:1.0:1789121188.804970:0:17865:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff94689124d800:17865] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.806049:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806058:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806072:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806079:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806085:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806092:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806098:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806104:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806112:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806118:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806124:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806130:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806135:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806142:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806149:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806154:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806160:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806166:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806193:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806199:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806206:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806211:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806217:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806223:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806229:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806235:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806241:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806245:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806251:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806256:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806262:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806268:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806274:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806280:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806286:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806291:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806297:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806304:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806313:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806320:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806326:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806331:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806337:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806342:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806347:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806353:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806359:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806365:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806371:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806377:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806382:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806387:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806392:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806406:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806412:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806417:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806424:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806430:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806435:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806440:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806445:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806450:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806456:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.806462:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121188.808145:0:17869:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff946783b0c200:17869] 2 exiting: rc = 0 00000100:00100000:2.0:1789121188.809232:0:17868:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9468c1bcc600:17868] 1 exiting: rc = 0 00000100:00100000:3.0:1789121188.809581:0:17867:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9468c1bcce00:17867] 0 exiting: rc = 1 00000100:00100000:0.0:1789121188.811425:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811441:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811449:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811459:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811466:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811474:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811480:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811487:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811494:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811536:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811543:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811550:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811557:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811564:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811570:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811578:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811586:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811594:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811600:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811608:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811614:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811622:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811628:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811636:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811659:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811667:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811674:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811682:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811689:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811696:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811703:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811711:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811717:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811740:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811748:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811758:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811765:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811774:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811781:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811788:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811795:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811802:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811808:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811815:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811843:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811853:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.811865:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813057:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813092:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813100:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813106:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813112:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813119:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813127:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813134:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813141:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813150:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813159:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813166:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813199:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813208:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813214:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813221:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121188.813232:0:21638:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789121188.832217:0:21638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121188.832249:0:21638:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789121188.832257:0:21638:0:(genops.c:885:class_export_put()) final put ffff946888743000/MDS_uuid 00000020:00000080:1.0:1789121188.832263:0:21638:0:(genops.c:844:class_export_destroy()) destroying export ffff946888743000/MDS_uuid for MDS 00000020:01000000:1.0:1789121188.832279:0:21638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789121188.832503:0:21638:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789121189.394217:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121190.422351:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121191.442894:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121192.466162:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789121192.859328:0:21839:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789121192.883512:0:21839:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789121192.883594:0:21839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121192.883615:0:21839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121192.883624:0:21839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121192.883633:0:21839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121192.884356:0:21839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789121192.884390:0:21839:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789121192.884433:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121192.884449:0:21839:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468b99b0000 x1876028970743936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121203 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121192.884476:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789121192.884483:0:21839:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789121192.884491:0:21839:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789121192.884498:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121192.884501:0:21839:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468b99b0000 x1876028970743936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121203 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121192.884508:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789121192.884511:0:21839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1789121192.884526:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970743936:0@lo:38:kworker.0 00000100:00080000:1.0:1789121192.886604:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121192.886629:0:21839:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468b99b21c0 x1876028970744064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121204 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121192.886788:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789121192.886797:0:21839:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789121192.886895:0:21839:0:(import.c:65:import_set_state_nolock()) ffff9468aa981800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789121192.886957:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970744448:0@lo:39:umount.0 00000400:00000100:3.0:1789121192.887030:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744448 offset 0 length 224: 4 00010000:00010000:2.0:1789121192.887193:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121192.887206:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121192.887218:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121192.887223:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121192.887235:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121192.887254:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121192.887261:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121192.887264:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789121192.887268:0:17842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789121192.887288:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:2.0:1789121192.887291:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121192.887313:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121192.889334:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970744064:0@lo:400:kworker.0 00010000:00010000:0.0:1789121192.889380:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121192.889384:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121192.889387:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121193.490754:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121193.874739:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121193.874749:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121193.874752:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121193.874755:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121193.874869:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970744576:0@lo:400:kworker.0 00000400:00000100:0.0:1789121193.874954:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744576 offset 0 length 224: 4 00000001:00100000:2.0:1789121193.878111:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789121193.878125:0:19362:0:(genops.c:885:class_export_put()) final put ffff9468afc6c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789121193.878376:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afc6c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789121193.887364:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afc6f000 for lustre-OST0000 00010000:00010000:0.0:1789121194.515371:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121195.542286:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121196.562055:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121197.589896:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121198.034052:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121188/real 1789121188] req@ffff9467848fb840 x1876028970743808/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121198 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121198.034098:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9467848fb840 x1876028970743808/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121198 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121198.034125:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121198.034223:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789121198.034228:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970743808:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789121198.037861:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121198.037878:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789121198.037885:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121198.037897:0:8921:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1789121198.037905:0:8921:0:(import.c:589:import_select_connection()) MGC192.168.202.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121198.037915:0:8921:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946888742800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121198.037972:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848f9680 x1876028970744704/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121198.038151:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121198.038156:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121198.038331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970744832:0@lo:400:kworker.0 00000400:00000100:2.0:1789121198.038424:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744832 offset 0 length 224: 4 00000100:00100000:3.0:1789121198.039056:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970744704:0@lo:250:kworker.0 00000400:00000100:3.0:1789121198.039098:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970744704 offset 0 length 520: 4 00010000:00010000:0.0:1789121198.610115:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121199.634219:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121200.658035:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121201.683433:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121202.130497:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121192/real 1789121192] req@ffff9468b99b2580 x1876028970744448/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121202 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121202.130544:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468b99b2580 x1876028970744448/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121202 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121202.130572:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468aa981800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789121202.130665:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970744448:0@lo:39:umount.0 00000100:00080000:1.0:1789121202.135095:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121202.135108:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789121202.135119:0:21839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789121202.138391:0:21839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138418:0:21839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138427:0:21839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138457:0:21839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138548:0:21839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121202.138558:0:21839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138565:0:21839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138571:0:21839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121202.138578:0:21839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141254:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121202.141277:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141293:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121202.141298:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141313:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121202.141335:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121202.141342:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121202.141345:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789121202.141365:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121202.141369:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141378:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141401:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121202.141406:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141412:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121202.141415:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141450:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121202.141456:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121202.141461:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789121202.141463:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789121202.141468:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121202.141472:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121202.141480:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121202.141482:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121202.141484:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121202.146044:0:21839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789121202.146065:0:21839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121202.146095:0:21839:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789121202.146109:0:21839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789121202.146112:0:21839:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789121202.146168:0:21839:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789121202.146173:0:21839:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789121202.146187:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121202.146194:0:21839:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789121202.146199:0:21839:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff94688415ced8) has no exports 00000020:00080000:1.0:1789121202.146370:0:21839:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff94688415ced8) has no exports 00010000:00010000:2.0:1789121202.147117:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789121202.150597:0:21839:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884ea3780 - data ffff94678252f1b0/ffff9468c072bc00 00000020:01000000:1.0:1789121202.151198:0:21839:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94689d460900 - data ffff946782549e58/ffff9468c159e400 00100000:10000000:2.0:1789121202.166898:0:21839:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789121202.204250:0:21839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310738 00000020:00000080:3.0:1789121202.204271:0:21839:0:(genops.c:885:class_export_put()) final put ffff9467838ec800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789121202.204316:0:21839:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468c081e000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789121202.204321:0:21839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468c081e000 2 00000020:01000004:3.0:1789121202.204324:0:21839:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9468c081e000 from lustre-OST0000 00000020:00000080:3.0:1789121202.204375:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121202.204389:0:21839:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789121202.204393:0:21839:0:(genops.c:885:class_export_put()) final put ffff9467838eb800/lustre-OST0000_UUID 00000020:00000080:3.0:1789121202.204397:0:21839:0:(genops.c:844:class_export_destroy()) destroying export ffff9467838eb800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789121202.204406:0:21839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789121202.204504:0:21839:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789121202.204509:0:21839:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789121202.204514:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121202.204520:0:21839:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789121202.204529:0:21839:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9468aa987800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121202.204535:0:21839:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff946882bf3490) has exports, disconnecting them 00000020:00080000:3.0:1789121202.204541:0:21839:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9468aa987800), last request at 1789121122 00000020:00000080:3.0:1789121202.204545:0:21839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310762 00000020:00080000:3.0:1789121202.204554:0:21839:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468aa987800): rc 0 00000020:00000080:3.0:1789121202.204560:0:21839:0:(genops.c:885:class_export_put()) final put ffff9468aa987800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789121202.208180:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467838ec800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789121202.208216:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468aa987800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789121202.208253:0:21839:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789121202.208259:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121202.208265:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789121202.208273:0:21839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789121202.208562:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121202.208574:0:21839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1789121202.208583:0:21839:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789121202.208591:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121202.208596:0:21839:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789121202.208605:0:21839:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9468aa980000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121202.208611:0:21839:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff946783c79a48) has exports, disconnecting them 00000020:00080000:0.0:1789121202.208630:0:21839:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9468aa980000), last request at 1789121122 00000020:00000080:0.0:1789121202.208635:0:21839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310777 00000020:00080000:0.0:1789121202.208655:0:21839:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468aa980000): rc 0 00000020:00000080:0.0:1789121202.208662:0:21839:0:(genops.c:885:class_export_put()) final put ffff9468aa980000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789121202.211538:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afc68800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789121202.211565:0:8921:0:(genops.c:885:class_export_put()) final put ffff946782aec800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789121202.211569:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789121202.211580:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789121202.211679:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468aa980000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789121202.294937:0:21839:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789121202.294953:0:21839:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789121202.294959:0:21839:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789121202.294970:0:21839:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789121202.295022:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468aa981800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789121202.295397:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121202.295428:0:21839:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789121202.295435:0:21839:0:(genops.c:885:class_export_put()) final put ffff9468aa985800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789121202.295441:0:21839:0:(genops.c:844:class_export_destroy()) destroying export ffff9468aa985800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789121202.295458:0:21839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789121202.295635:0:21839:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468c081e000 1 00000020:00000080:3.0:1789121202.295645:0:21839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310715 00000020:00000080:3.0:1789121202.295654:0:21839:0:(genops.c:885:class_export_put()) final put ffff946782aeb800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789121202.295670:0:21839:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789121202.295683:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aeb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789121202.295696:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121202.295702:0:21839:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789121202.295706:0:21839:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9468ab904ed8) has no exports 00000020:00000080:1.0:1789121202.440857:0:21839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121202.440881:0:21839:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789121202.440890:0:21839:0:(genops.c:885:class_export_put()) final put ffff9468c081b800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789121202.440897:0:21839:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c081b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789121202.440917:0:21839:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789121202.441406:0:21839:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9468c081f000 00000020:02000400:1.0:1789121202.441475:0:21839:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789121202.705988:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789121203.091421:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121203.091437:0:19798:0:(pinger.c:247:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121203.091441:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121203.091445:0:19798:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121203.091539:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121203.091565:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970744960:0@lo:400:kworker.0 00000400:00000100:0.0:1789121203.091638:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970744960 offset 0 length 224: 4 00000100:00100000:3.0:1789121203.154921:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121188/real 1789121188] req@ffff9468b99b30c0 x1876028970744192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789121203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121203.154965:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468b99b30c0 x1876028970744192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789121203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121203.154992:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121203.155024:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121203.155029:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970744192:0@lo:38:kworker.0 00000100:00080000:2.0:1789121203.155207:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121203.155214:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121203.155217:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121203.155220:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789121203.155223:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121203.155229:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1789121203.155256:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789121203.155264:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946782978800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121203.155308:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebc000 x1876028970745088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121203.156873:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970745088:0@lo:38:kworker.0 00000400:00000100:3.0:1789121203.156958:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970745088 offset 0 length 520: 4 00010000:00010000:2.0:1789121203.740478:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789121204.116096:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121188/real 1789121188] req@ffff9468b99b3c00 x1876028970744320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121204.140179:0:3646:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9468b99b3c00 x1876028970744320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789121204.140198:0:3646:0:(import.c:65:import_set_state_nolock()) ffff946783953800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789121204.140203:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789121204.152590:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1789121204.152672:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121204.152679:0:19798:0:(pinger.c:247:ptlrpc_pinger_process_import()) 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121204.152682:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121204.152686:0:19798:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121204.152688:0:19798:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121204.152691:0:19798:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789121204.152695:0:19798:0:(import.c:65:import_set_state_nolock()) ffff946783953800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121204.152705:0:19798:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 587 00000100:00080000:2.0:1789121204.152716:0:19798:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff946783953800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121204.152768:0:19798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebfc00 x1876028970745216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121204.152897:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970745216:0@lo:38:kworker.0 00000400:00000100:3.0:1789121204.152993:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970745216 offset 0 length 520: 4 00000100:00100000:0.0:1789121204.153350:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970744320:0@lo:400:kworker.0 00010000:00010000:0.0:1789121204.755097:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121205.778036:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121206.802086:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789121207.426727:0:22041:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789121207.446228:0:22041:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789121207.446365:0:22041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121207.446386:0:22041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121207.446395:0:22041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121207.446404:0:22041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121207.446456:0:22041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789121207.446464:0:22041:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789121207.446498:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121207.446513:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebc000 x1876028970745088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121223 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.446537:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789121207.446545:0:22041:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789121207.446553:0:22041:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789121207.446559:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121207.446563:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebc000 x1876028970745088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121223 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.446570:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789121207.446573:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1789121207.446782:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970745088:0@lo:38:kworker.0 00010000:00010000:2.0:1789121207.447056:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121207.447067:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121207.447076:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121207.447081:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121207.447093:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121207.447111:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121207.447118:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121207.447121:0:17843:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789121207.447123:0:17843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789121207.447141:0:17843:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:2.0:1789121207.447147:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121207.447155:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121207.447168:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121207.447170:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121207.447171:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789121207.449518:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121207.449545:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebf840 x1876028970744576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.449634:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848fa940 x1876028970744832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121214 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.449662:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848fb840 x1876028970744960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.449681:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebfc00 x1876028970745216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121214 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.449694:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789121207.449701:0:22041:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789121207.449709:0:22041:0:(import.c:65:import_set_state_nolock()) ffff946783953800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789121207.449717:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121207.449744:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebf840 x1876028970744576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121209 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121207.449858:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970744832:0@lo:400:kworker.0 00000100:00100000:0.0:1789121207.450028:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970744960:0@lo:400:kworker.0 00000100:00100000:2.0:1789121207.450107:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970744576:0@lo:400:kworker.0 00000100:00100000:1.0:1789121207.450136:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848fa940 x1876028970744832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121214 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.450145:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848fb840 x1876028970744960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121219 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.450153:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783ebfc00 x1876028970745216/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121214 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121207.450160:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789121207.450225:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970745216:0@lo:38:kworker.0 00000100:00100000:1.0:1789121207.450575:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789121207.453416:0:22041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453445:0:22041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453455:0:22041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453462:0:22041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453557:0:22041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121207.453566:0:22041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453574:0:22041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453581:0:22041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121207.453588:0:22041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453691:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121207.453700:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453709:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121207.453713:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453723:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121207.453763:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121207.453770:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121207.453773:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789121207.453790:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121207.453794:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453802:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453873:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121207.453877:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453884:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121207.453887:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453894:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121207.453907:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121207.453912:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789121207.453914:0:17842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789121207.453919:0:17842:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121207.453929:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.453937:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121207.453939:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121207.453941:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121207.454228:0:22041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121207.454234:0:22041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121207.454263:0:22041:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789121207.454268:0:22041:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789121207.454271:0:22041:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789121207.454376:0:22041:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789121207.454382:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789121207.454390:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121207.454397:0:22041:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789121207.454402:0:22041:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9468c0874ed8) has no exports 00000020:00080000:3.0:1789121207.454545:0:22041:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9468c0874ed8) has no exports 00010000:00010000:2.0:1789121207.456030:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789121207.457626:0:22041:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946884ea3d20 - data ffff9468ab0a3798/ffff9468c0728800 00000020:01000000:3.0:1789121207.458337:0:22041:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9467822d5720 - data ffff9468ab065798/ffff94678482c000 00100000:10000000:3.0:1789121207.476410:0:22041:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789121207.522533:0:22041:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a8310896 00000020:00000080:0.0:1789121207.522554:0:22041:0:(genops.c:885:class_export_put()) final put ffff946783957800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789121207.522763:0:22041:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468aa987000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789121207.522775:0:22041:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468aa987000 2 00000020:01000004:0.0:1789121207.522779:0:22041:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9468aa987000 from lustre-OST0001 00000020:00000080:0.0:1789121207.522815:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121207.522846:0:22041:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789121207.522851:0:22041:0:(genops.c:885:class_export_put()) final put ffff946783952800/lustre-OST0001_UUID 00000020:00000080:0.0:1789121207.522855:0:22041:0:(genops.c:844:class_export_destroy()) destroying export ffff946783952800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789121207.522862:0:22041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789121207.523077:0:22041:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS 00010000:00010000:0.0:1789121207.523101:0:22041:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121207.523118:0:22041:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121207.523125:0:22041:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789121207.523128:0:22041:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789121207.523132:0:22041:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789121207.523152:0:22041:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121207.523157:0:22041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121207.523174:0:22041:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121207.523314:0:22041:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121207.523320:0:22041:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121207.523322:0:22041:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789121207.523324:0:22041:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789121207.523337:0:22041:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946888742800 00010000:00010000:0.0:1789121207.523340:0:22041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789121207.523361:0:22041:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789121207.523366:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789121207.523368:0:22041:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789121207.523370:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789121207.523429:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789121207.523447:0:22041:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9467848f9680 x1876028970744704/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789121213 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789121207.523475:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789121207.523478:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1789121207.523565:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970744704:0@lo:250:kworker.0 10000000:01000000:0.0:1789121207.523726:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789121207.523734:0:22041:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83104bb 00000020:00000080:0.0:1789121207.523740:0:22041:0:(genops.c:885:class_export_put()) final put ffff946888747000/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee 00000020:00000080:1.0:1789121207.526855:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783957800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789121207.529225:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.132@tcp (flags='') 00000020:00000080:0.0:1789121207.529252:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121207.529265:0:22041:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789121207.529272:0:22041:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff946783ca3490) has no exports 10000000:01000000:0.0:1789121207.529338:0:17851:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789121207.529447:0:22041:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.132@tcp: client import never connected 00000100:00080000:0.0:1789121207.529453:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789121207.529459:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789121207.529482:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789121207.529485:0:22041:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789121207.533164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946888747000/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee for MGC192.168.202.132@tcp 00000020:00000080:0.0:1789121207.533727:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121207.533755:0:22041:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.132@tcp (uuid 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee) 00000020:01000000:0.0:1789121207.533767:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789121207.533779:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121207.533787:0:22041:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789121207.533797:0:22041:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94678297b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121207.533805:0:22041:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9468ab903490) has exports, disconnecting them 00000020:00080000:0.0:1789121207.533812:0:22041:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94678297b800), last request at 1789121137 00000020:00000080:0.0:1789121207.533840:0:22041:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83108c0 00000020:00080000:0.0:1789121207.533864:0:22041:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94678297b800): rc 0 00000020:00000080:0.0:1789121207.533871:0:22041:0:(genops.c:885:class_export_put()) final put ffff94678297b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789121207.534814:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946888742800 for MGC192.168.202.132@tcp 00000020:00000080:2.0:1789121207.534842:0:8921:0:(genops.c:885:class_export_put()) final put ffff946888745000/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee 00000020:00000080:2.0:1789121207.534846:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946888745000/057e0b0e-c04f-45aa-a41a-bc7b139fb1ee for MGC192.168.202.132@tcp 00000020:01000000:2.0:1789121207.534863:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.132@tcp (057e0b0e-c04f-45aa-a41a-bc7b139fb1ee) 00000020:00000080:2.0:1789121207.535495:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff94678297b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789121207.538932:0:22041:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789121207.538946:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789121207.538952:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789121207.538965:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789121207.539252:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121207.539264:0:22041:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789121207.539274:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789121207.539285:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121207.539291:0:22041:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789121207.539302:0:22041:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff946783953000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789121207.539311:0:22041:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9468c0871a48) has exports, disconnecting them 00000020:00080000:1.0:1789121207.539316:0:22041:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff946783953000), last request at 1789121137 00000020:00000080:1.0:1789121207.539322:0:22041:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a83108d5 00000020:00080000:1.0:1789121207.539348:0:22041:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946783953000): rc 0 00000020:00000080:1.0:1789121207.539355:0:22041:0:(genops.c:885:class_export_put()) final put ffff946783953000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789121207.540192:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782978800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789121207.540208:0:37:0:(genops.c:885:class_export_put()) final put ffff946782979800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789121207.540230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946782979800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789121207.540239:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789121207.540329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783953000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789121207.541367:0:22041:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789121207.541376:0:22041:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789121207.541382:0:22041:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789121207.541390:0:22041:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121207.541431:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783953800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789121207.545927:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789121207.546151:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1789121207.575061:0:17838:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9467821d4800:17838] 1 exiting: rc = 0 00000100:00100000:2.0:1789121207.575412:0:17837:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9467821d4c00:17837] 0 exiting: rc = 1 00000100:00100000:2.0:1789121207.575517:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121207.576648:0:17841:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9468913a0400:17841] 2 exiting: rc = 0 00000100:00100000:2.0:1789121207.585707:0:20893:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff946782a04400:20893] 3 exiting: rc = 0 00000100:00100000:2.0:1789121207.587055:0:17839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9467821d5000:17839] 0 exiting: rc = 1 00000100:00100000:1.0:1789121207.587610:0:17840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9467821d5400:17840] 1 exiting: rc = 0 00000100:00100000:2.0:1789121207.594948:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.594966:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.594974:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.594981:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.594990:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.594998:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595005:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595011:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595016:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595023:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595028:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595034:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595041:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595048:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595054:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595059:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595082:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595089:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595096:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595102:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595109:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595117:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595124:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595131:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595137:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595144:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595150:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595157:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595163:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595171:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595177:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595184:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595190:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595196:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595203:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595209:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595216:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595223:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595231:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595237:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595243:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595250:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595256:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595262:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595268:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595274:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595280:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595286:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595293:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595299:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595304:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.595318:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.596724:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.596737:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.596753:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.596760:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597185:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597194:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597201:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597214:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597221:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597227:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597232:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.597238:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789121207.602219:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121207.602242:0:22041:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789121207.602250:0:22041:0:(genops.c:885:class_export_put()) final put ffff946783955000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789121207.602257:0:22041:0:(genops.c:844:class_export_destroy()) destroying export ffff946783955000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789121207.602265:0:22041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789121207.602656:0:22041:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468aa987000 1 00000020:00000080:2.0:1789121207.602665:0:22041:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a831087a 00000020:00000080:2.0:1789121207.602673:0:22041:0:(genops.c:885:class_export_put()) final put ffff946782ae8800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789121207.602695:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789121207.602712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946782ae8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789121207.602732:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121207.602740:0:22041:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789121207.602753:0:22041:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff946783c7b490) has no exports 00000020:00000080:2.0:1789121207.642291:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121207.642306:0:22041:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789121207.642312:0:22041:0:(genops.c:885:class_export_put()) final put ffff9468aa984000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789121207.642317:0:22041:0:(genops.c:844:class_export_destroy()) destroying export ffff9468aa984000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789121207.642329:0:22041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789121207.642704:0:22041:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9468aa985000 00000020:01000000:2.0:1789121207.642756:0:22041:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789121207.642761:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121207.642766:0:22041:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789121207.642771:0:22041:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff946882bf4ed8) has no exports 00000020:00000080:2.0:1789121207.642796:0:22041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121207.642802:0:22041:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789121207.642805:0:22041:0:(genops.c:885:class_export_put()) final put ffff946782aed800/OSS_uuid 00000020:00000080:2.0:1789121207.642807:0:22041:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aed800/OSS_uuid for OSS 00000020:01000000:2.0:1789121207.642811:0:22041:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789121207.643143:0:19368:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9468a386a400:19368] 2 exiting: rc = 0 00000100:00100000:2.0:1789121207.643262:0:19367:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9468afc19e00:19367] 1 exiting: rc = 0 00000100:00100000:0.0:1789121207.643382:0:19366:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff946883579e00:19366] 0 exiting: rc = 1 00000100:00080000:3.0:1789121207.643449:0:17850:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789121207.644722:0:20006:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff946784a05200:20006] 3 exiting: rc = 0 00000100:00100000:2.0:1789121207.644866:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644893:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644900:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644907:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644912:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644917:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644924:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644930:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644937:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644944:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644951:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644957:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644963:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644969:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644979:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644986:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.644993:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645007:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645015:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645022:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645029:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645034:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645052:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645060:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645084:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645090:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645097:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645104:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645115:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645123:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645128:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645134:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645140:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645157:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645164:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645171:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645176:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645182:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645188:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645193:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645199:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645204:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645209:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645215:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645242:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645250:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645256:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645260:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645264:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645267:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645271:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645274:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645278:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645282:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645285:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645288:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645291:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645294:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645299:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645313:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645319:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645325:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645332:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.645338:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.646309:0:19370:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff946783d73400:19370] 1 exiting: rc = 0 00000100:00100000:0.0:1789121207.646330:0:19369:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9468c1648e00:19369] 0 exiting: rc = 1 00000100:00100000:2.0:1789121207.648073:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648091:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648095:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648101:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648107:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648114:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648119:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648124:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648130:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648136:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648142:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648147:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648153:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648158:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648162:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648167:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648171:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648174:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648178:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648182:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648185:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648188:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648192:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648197:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648201:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648208:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648214:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648222:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648227:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648233:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648261:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648264:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648269:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648273:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648276:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648280:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648284:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648287:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648290:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648293:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648297:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648300:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648303:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648306:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648309:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648313:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648316:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648319:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648322:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648325:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648328:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648332:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648336:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648339:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648343:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648346:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648349:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648352:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648356:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648359:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648361:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648365:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648368:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.648371:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.653186:0:19372:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9468c153f200:19372] 1 exiting: rc = 0 00000100:00100000:0.0:1789121207.653643:0:19373:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9468c153ec00:19373] 2 exiting: rc = 0 00000100:00100000:1.0:1789121207.655915:0:19371:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9468840e8800:19371] 0 exiting: rc = 1 00000100:00100000:3.0:1789121207.656062:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656073:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656080:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656087:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656094:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656101:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656117:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656160:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656168:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656175:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656182:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656188:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656194:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656201:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656207:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656214:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656241:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656248:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656255:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656263:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656269:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656276:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656283:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656290:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656296:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656304:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656310:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656316:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656323:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656331:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656337:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656363:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656373:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656382:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656389:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656396:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656402:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656409:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656416:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656425:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656432:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656439:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656445:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656453:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656460:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656466:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656473:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656480:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656487:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656495:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656502:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656519:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656526:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656532:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656539:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656546:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656563:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656580:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656599:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656606:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656613:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656619:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656626:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.656633:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121207.669381:0:19375:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9468c1643a00:19375] 1 exiting: rc = 0 00000100:00100000:0.0:1789121207.669809:0:19374:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9468c153f800:19374] 0 exiting: rc = 1 00000100:00100000:3.0:1789121207.670208:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670217:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670224:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670231:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670237:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670243:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670251:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670257:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670264:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670270:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670276:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670282:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670288:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670294:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670300:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670305:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670311:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670317:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670402:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670413:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670419:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670425:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670443:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670450:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670456:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670462:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670472:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670479:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670485:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670493:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670502:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670508:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670514:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670522:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670537:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670545:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670551:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670557:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670564:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670570:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670576:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670582:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670588:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670594:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670600:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670606:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670613:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670618:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670624:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670631:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670637:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670643:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670649:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670656:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670662:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670675:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670698:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670711:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670718:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670723:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670729:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670736:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670741:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.670764:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121207.672627:0:19376:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9468bb619400:19376] 0 exiting: rc = 1 00000100:00100000:2.0:1789121207.672782:0:19377:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff946885606600:19377] 1 exiting: rc = 0 00000100:00100000:3.0:1789121207.673308:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673318:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673339:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673348:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673355:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673362:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673369:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673376:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673404:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673413:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673419:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673426:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673433:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673440:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673446:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673452:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673459:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673465:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673470:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673477:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673498:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673506:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673513:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673520:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673525:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673531:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673538:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673545:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673566:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673575:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673581:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673587:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673609:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673617:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673623:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673629:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673635:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673641:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673648:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673655:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673662:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673669:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673676:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673682:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673707:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673715:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673722:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673730:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673737:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673760:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673768:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673775:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673782:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673788:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673794:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673801:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673962:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673970:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673979:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673989:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.673999:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.674006:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.674013:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121207.674028:0:22041:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789121207.688728:0:22041:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789121231.868981:0:22807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789121243.622042:0:23408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789121243.622049:0:23408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789121243.622051:0:23408:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789121243.622245:0:23408:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9468c076d800 00000020:01000004:0.0:1789121243.622265:0:23408:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789121243.622273:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789121243.622287:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff946884159a48) 00000020:00000080:0.0:1789121243.622302:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789121243.694463:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789121243.694865:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.696337:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.696701:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.696903:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.697217:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.697423:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.697769:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.698091:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.698396:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.698660:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.698876:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.699054:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.699295:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.699593:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.699861:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.700077:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.700357:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.700682:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.701311:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.701653:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.701918:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.702318:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.702605:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.702851:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.703071:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.703354:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.704006:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.704290:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.704685:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.704875:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.705104:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.705365:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789121243.705650:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789121243.706698:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.709232:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.709438:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.710057:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.710500:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.710799:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.711223:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.711473:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.711900:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.712212:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.712462:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.712770:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.713096:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789121243.714248:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.714854:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.715070:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.715595:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.715849:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789121243.716030:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1789121243.716600:0:23408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789121243.717343:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789121243.717352:0:23408:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789121243.717365:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310d2e 00000020:01000004:2.0:1789121243.717373:0:23408:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789121243.717378:0:23408:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789121243.717384:0:23408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468c076d800 from MGS 00000020:01000004:2.0:1789121243.717388:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789121243.717398:0:23408:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9468c0871a48) 00000020:00000080:2.0:1789121243.717417:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789121243.717483:0:23408:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c076d800 from MGS, refs=2 00080000:01000000:2.0:1789121243.717488:0:23408:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789121243.717493:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310d3c 00000100:00100000:2.0:1789121243.717631:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789121243.717768:0:23408:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789121243.717774:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789121243.718319:0:23408:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789121243.718327:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789121243.719103:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789121243.719292:0:23408:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789121243.719298:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789121243.720139:0:23408:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789121243.720148:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789121243.720904:0:23408:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789121243.720913:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789121243.722432:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121243.722437:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121243.722439:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121243.723317:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121243.723321:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121243.723322:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121243.724147:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789121243.728706:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789121243.731147:0:23408:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789121243.733298:0:23420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789121243.733456:0:23408:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789121243.733496:0:23408:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789121243.734610:0:23408:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789121243.735084:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121243.735212:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789121243.735216:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789121243.743028:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789121243.743041:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789121243.743359:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789121243.743366:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789121243.744242:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789121243.744263:0:23408:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.132@tcp' 00000020:01000004:1.0:1789121243.744265:0:23408:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789121243.744298:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.132@tcp (typ=mgc) 00000020:00000080:1.0:1789121243.744310:0:23408:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.132@tcp (ffff946882bf0000) 00000020:00000080:1.0:1789121243.744327:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789121243.744418:0:23408:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946785109800@MGC192.168.202.132@tcp: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121243.744590:0:23408:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.132@tcp-0 is initialized 00000040:01000000:1.0:1789121243.744597:0:23408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789121243.745015:0:23425:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789121243.751495:0:23426:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789121243.751701:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.132@tcp (uuid 4ea47eb7-f73f-4e5e-957f-1a8c2d51392c) 00000020:00000080:2.0:1789121243.751726:0:23408:0:(genops.c:1385:class_connect()) connect: client 4ea47eb7-f73f-4e5e-957f-1a8c2d51392c, cookie 0xb74d2367a8310d4a 00000100:00080000:2.0:1789121243.751741:0:23408:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121243.751748:0:23408:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946785109800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121243.751783:0:23408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebf480 x1876028970745344/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121243.751806:0:23408:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4ea47eb7-f73f-4e5e-957f-1a8c2d51392c->MGS 00000020:01000004:2.0:1789121243.751857:0:23408:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789121243.751863:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789121243.751876:0:23408:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9468c0873490) 00000020:00000080:2.0:1789121243.751888:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789121243.752082:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3643:1876028970745344:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789121243.752169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121243.752248:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745344 00000100:00100000:0.0:1789121243.752257:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745344 00000100:00100000:0.0:1789121243.752285:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789121243.752293:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876028970745344:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789121243.752315:0:23421:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4ea47eb7-f73f-4e5e-957f-1a8c2d51392c@0@lo t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:0.0:1789121243.752334:0:23421:0:(genops.c:1385:class_connect()) connect: client 4ea47eb7-f73f-4e5e-957f-1a8c2d51392c, cookie 0xb74d2367a8310d58 00000100:00080000:0.0:1789121243.752473:0:23421:0:(import.c:65:import_set_state_nolock()) ffff9468c0768800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121243.752537:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+5:3643:x1876028970745344:12345-0@lo:250:mount.lustre.0 Request processed in 243us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121243.752545:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789121243.752599:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789121243.752607:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.132@tcp: connect to target with instance 0 00000100:00080000:0.0:1789121243.752614:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789121243.752618:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789121243.752622:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946785109800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789121243.752624:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789121243.752630:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789121243.752634:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3643:1876028970745344:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789121243.769472:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121243.770012:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789121243.770019:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789121243.780437:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789121243.780450:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789121243.780960:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789121243.780968:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789121243.781761:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121243.781973:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789121243.781979:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789121243.782680:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789121243.782688:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789121243.823457:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121243.823753:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789121243.823759:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789121243.824983:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789121243.824991:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789121243.825491:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121243.825754:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789121243.825759:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789121243.826441:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789121243.826450:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789121243.827183:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121243.827335:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789121243.827340:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789121243.828012:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789121243.828018:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789121243.832719:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121243.832983:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789121243.832989:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789121243.833498:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789121243.833505:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789121243.866384:0:23408:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121243.866757:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789121243.866765:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789121243.870891:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789121243.871041:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789121243.872810:0:23408:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789121243.873725:0:23408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789121243.875275:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789121243.875305:0:23408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789121243.875311:0:23408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789121243.875446:0:23408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789121243.875483:0:23408:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789121243.875488:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789121243.875490:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121243.875492:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121243.875493:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121243.875494:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121243.875496:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121243.875497:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121243.875499:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121243.875501:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121243.875502:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121243.875505:0:23408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789121243.875507:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121243.875509:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121243.875510:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121243.875521:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121243.875523:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121243.875529:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121243.875531:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121243.875531:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121243.875532:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121243.875533:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121243.875630:0:23408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789121243.875654:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121243.875736:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121243.875800:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783095000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121243.875891:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745472 00000100:00100000:0.0:1789121243.875898:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745472 00000100:00100000:0.0:1789121243.875942:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121243.875951:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+5:23408:x1876028970745472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789121243.875996:0:23424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789121243.875999:0:23424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789121243.876002:0:23424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789121243.876784:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789121243.877486:0:23424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789121243.879326:0:23446:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789121243.879333:0:23446:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789121243.879336:0:23446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789121243.879339:0:23446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789121243.879635:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789121243.879941:0:23424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789121243.879953:0:23424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789121243.882089:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+5:23408:x1876028970745472:12345-0@lo:253:mount.lustre.0 Request processed in 6127us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121243.882122:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121243.882130:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745472:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789121243.882152:0:23408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789121243.882155:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789121243.882156:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789121243.882158:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121243.882159:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121243.882160:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121243.882161:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121243.882162:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121243.882163:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789121243.882164:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121243.882165:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789121243.882193:0:23408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468c076d800 from lustre-MDT0000 10000000:01000000:1.0:1789121243.882220:0:23408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789121243.882222:0:23408:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789121243.882226:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff946882bf0000 10000000:01000000:1.0:1789121243.882228:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789121243.882235:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff946882bf0000 from 1 10000000:01000000:1.0:1789121243.882237:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789121243.882271:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121243.882278:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121243.882285:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121243.882300:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121243.882349:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121243.882395:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75180 going to sleep for 11 seconds 00000100:00100000:0.0:1789121243.882425:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745600 00000100:00100000:0.0:1789121243.882435:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745600 00000100:00100000:0.0:1789121243.882547:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121243.882569:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+5:23408:x1876028970745600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121243.882589:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121243.882651:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ad800/0xb74d2367a8310d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310d5f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121243.882682:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ad800/0xb74d2367a8310d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310d5f expref: 6 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121243.882695:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ad800/0xb74d2367a8310d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310d5f expref: 6 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121243.882726:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ad800, rc 0) 00000100:00100000:0.0:1789121243.882782:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+6:23408:x1876028970745600:12345-0@lo:101:mount.lustre.0 Request processed in 216us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121243.882789:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121243.882895:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121243.882913:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.882923:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121243.883003:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121243.883047:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121243.883502:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121243.883634:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745728 00000100:00100000:1.0:1789121243.883651:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745728 00000100:00100000:1.0:1789121243.883683:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121243.883690:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+6:23408:x1876028970745728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121243.883786:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+6:23408:x1876028970745728:12345-0@lo:501:mount.lustre.0 Request processed in 96us (738us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789121243.883793:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121243.883914:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789121243.883956:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789121243.883972:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.883982:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121243.883991:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9468c076d800 10000000:01000000:2.0:1789121243.883995:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789121243.884001:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9468c076d800 10000000:01000000:2.0:1789121243.884003:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789121243.884006:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9468c076d800 from 1 10000000:01000000:2.0:1789121243.884008:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789121243.884137:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.884146:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.884172:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121243.887784:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121243.887910:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121243.887971:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891b85600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121243.890982:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745856 00000100:00100000:1.0:1789121243.891004:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745856 00000100:00100000:1.0:1789121243.891117:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121243.891132:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+6:23408:x1876028970745856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121243.891162:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121243.891198:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310d6d expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121243.891234:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310d6d expref: 7 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121243.891248:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310d6d expref: 7 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121243.891259:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3200, rc 0) 00000100:00100000:1.0:1789121243.891611:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+7:23408:x1876028970745856:12345-0@lo:101:mount.lustre.0 Request processed in 425us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121243.891621:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121243.891687:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121243.891936:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d74 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121243.891951:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310d74 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121243.891976:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789121243.892072:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d74 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121243.892082:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e74c00/0xb74d2367a8310d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d74 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121243.892091:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789121243.892102:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789121243.892136:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9468c076d800 10000000:01000000:3.0:1789121243.892140:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789121243.892145:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789121243.892147:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789121243.892185:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121243.892191:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121243.892197:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121243.892213:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121243.892266:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121243.892302:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891b85600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121243.892323:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970745984 00000100:00100000:2.0:1789121243.892332:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970745984 00000100:00100000:2.0:1789121243.892439:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121243.892450:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+7:23408:x1876028970745984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121243.892461:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121243.892479:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e75200/0xb74d2367a8310d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310d7b expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.892502:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e75200/0xb74d2367a8310d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310d7b expref: 8 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.892526:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e75200/0xb74d2367a8310d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310d7b expref: 8 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121243.892535:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e75200, rc 0) 00000100:00100000:2.0:1789121243.892665:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+8:23408:x1876028970745984:12345-0@lo:101:mount.lustre.0 Request processed in 217us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121243.892672:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121243.892718:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970745984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121243.892734:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d82 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121243.892742:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310d82 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121243.892886:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970746112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121243.892980:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121243.893036:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891b85600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121243.893159:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970746112 00000100:00100000:1.0:1789121243.893165:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970746112 00000100:00100000:1.0:1789121243.893201:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789121243.893209:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+8:23408:x1876028970746112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121243.893635:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23408:x1876028970746112:12345-0@lo:501:mount.lustre.0 Request processed in 425us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121243.893644:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121243.893725:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970746112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121243.893776:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970746240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121243.893859:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121243.893958:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121243.893991:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970746240 00000100:00100000:3.0:1789121243.893996:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970746240 00000100:00100000:3.0:1789121243.894149:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121243.894158:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23408:x1876028970746240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121243.895796:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23408:x1876028970746240:12345-0@lo:503:mount.lustre.0 Request processed in 1627us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121243.895814:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121243.898416:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970746240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121243.899278:0:23447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23447:1876028970746368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789121243.899452:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121243.899548:0:23447:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121243.899669:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970746368 00000100:00100000:0.0:1789121243.899678:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970746368 00000100:00100000:0.0:1789121243.899775:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121243.899786:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23447:x1876028970746368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121243.900925:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23447:x1876028970746368:12345-0@lo:502:llog_process_th.0 Request processed in 1133us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121243.900938:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121243.901080:0:23447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23447:1876028970746368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789121243.901117:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121243.901132:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121243.901135:0:23447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789121243.901141:0:23447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789121243.901144:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121243.901163:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff946882bf1a48) 00000020:00000080:1.0:1789121243.901186:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789121243.901192:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789121243.901316:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789121243.901330:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310d90 00000020:00000080:1.0:1789121243.902552:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789121243.902567:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121243.902576:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121243.902578:0:23447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789121243.902581:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121243.902589:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121243.902591:0:23447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789121243.902595:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121243.902620:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff946882bf4ed8) 00000020:00000080:1.0:1789121243.902644:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789121243.902649:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789121243.902651:0:23447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789121243.902672:0:23447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789121243.902680:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789121243.902773:0:23447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c076d800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789121243.902786:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff946882bf3490) 00000020:00000080:1.0:1789121243.902808:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789121243.902888:0:23447:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789121243.902898:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310da5 00000020:00000080:1.0:1789121243.903103:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789121243.903111:0:23447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789121243.903116:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb74d2367a8310dac 00080000:01000000:1.0:1789121243.903124:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789121243.903129:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310db3 00010000:00010000:2.0:1789121243.972849:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789121243.974208:0:23447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1789121243.975310:0:23447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789121243.976738:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9468c0870000) 00000020:00000080:2.0:1789121243.976761:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789121243.976860:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789121243.976866:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310dc1 00000020:00000080:2.0:1789121243.977727:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789121243.987462:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb74d2367a8310dc8 00000020:00000080:3.0:1789121243.988987:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789121243.989013:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121243.989019:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.989021:0:23447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789121243.989025:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121243.989028:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789121243.989029:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121243.989030:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121243.989032:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121243.989034:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.989035:0:23447:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121243.989038:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121243.989041:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.989043:0:23447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789121243.989047:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789121243.989094:0:23447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789121243.989113:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121243.989116:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.989117:0:23447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789121243.989120:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121243.989123:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.989125:0:23447:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789121243.989128:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789121243.989132:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:3.0:1789121243.989160:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121243.989176:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9468ab903490) 00000020:00000080:3.0:1789121243.989191:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789121243.989200:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789121243.989257:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789121243.989263:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789121243.989271:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310dd6 00010000:00080000:3.0:1789121243.989307:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946886899000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121243.990941:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789121243.997690:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789121243.997708:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789121243.997756:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789121243.997777:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310ddd 00000100:00080000:3.0:1789121243.997789:0:23447:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121243.998206:0:23447:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946886899000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121243.998249:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468914812c0 x1876028970746496/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121243.998270:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789121243.998594:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121243.998610:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.998612:0:23447:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789121243.998616:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121243.998619:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1789121243.998621:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121243.998622:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121243.998624:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121243.998627:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.998628:0:23447:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121243.998631:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789121243.998635:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789121243.998639:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121243.998640:0:23447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789121243.998642:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1789121243.998645:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746496:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789121243.998646:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:3.0:1789121243.998680:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789121243.998683:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121243.998696:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9468ab904ed8) 00000020:00000080:3.0:1789121243.998708:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789121243.998712:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1789121243.998719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789121243.998772:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789121243.998778:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789121243.998784:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310deb 00000100:00100000:2.0:1789121243.998882:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970746496 00000100:00100000:2.0:1789121243.998890:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970746496 00000100:00100000:2.0:1789121243.998921:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121243.998929:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970746496:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789121243.998954:0:23434:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789121243.999461:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946784ac0000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121244.001343:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789121244.008474:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789121244.009461:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789121244.012121:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121244.012732:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789121244.020873:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789121244.022802:0:23453:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789121244.022809:0:23453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789121244.024279:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789121244.024293:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789121244.024340:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789121244.024365:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310df2 00000100:00080000:3.0:1789121244.024379:0:23447:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121244.024389:0:23447:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946784ac0000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121244.024450:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946891482940 x1876028970746624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121244.024526:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789121244.024619:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970746624 offset 0 length 520: 4 00000100:00080000:3.0:1789121244.024947:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789121244.025087:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121244.025093:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121244.025094:0:23447:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789121244.025098:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121244.025101:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789121244.025102:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121244.025104:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121244.025105:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121244.025108:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121244.025109:0:23447:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121244.025119:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789121244.025124:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789121244.025128:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121244.025129:0:23447:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789121244.025132:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789121244.025136:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:3.0:1789121244.025160:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789121244.025163:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121244.025175:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9468ab900000) 00000020:00000080:3.0:1789121244.025190:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789121244.025195:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789121244.025257:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789121244.025263:0:23447:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789121244.025268:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310e00 00010000:00080000:3.0:1789121244.025301:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783953000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121244.025527:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789121244.025759:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789121244.025782:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789121244.032252:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121244.032554:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789121244.035246:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:2.0:1789121244.035935:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970746496:12345-0@lo:38:llog_process_th.0 Request processed in 37000us (37209us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121244.035947:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789121244.036107:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121244.036114:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789121244.036118:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746496:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789121244.036556:0:23455:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789121244.036562:0:23455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789121244.037648:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789121244.037660:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789121244.037691:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789121244.037706:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310e07 00000100:00080000:0.0:1789121244.037718:0:23447:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121244.037723:0:23447:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121244.037752:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848fb0c0 x1876028970746752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121244.037775:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789121244.037840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746752:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1789121244.037857:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.037861:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.037862:0:23447:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789121244.037865:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.037869:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.037870:0:23447:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789121244.037872:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789121244.037874:0:23447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789121244.037876:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.037878:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.037879:0:23447:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789121244.037881:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.037883:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.037885:0:23447:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789121244.037888:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:2.0:1789121244.037892:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970746752 offset 0 length 520: 4 00000100:00100000:0.0:1789121244.037915:0:23447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23447:1876028970746880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121244.037965:0:23447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.037993:0:23447:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.038035:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970746880 00000100:00100000:2.0:1789121244.038042:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970746880 00000100:00100000:2.0:1789121244.038093:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789121244.038105:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23447:x1876028970746880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789121244.040111:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23447:x1876028970746880:12345-0@lo:502:llog_process_th.0 Request processed in 1999us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121244.040124:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121244.040124:0:23447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23447:1876028970746880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789121244.040166:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.040174:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.040176:0:23447:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789121244.040180:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789121244.040376:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789121244.040401:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789121244.040437:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d82 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.040449:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a8310d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d82 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121244.040457:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468c076d800 from 1 10000000:01000000:2.0:1789121244.040460:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121244.040639:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.040648:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.040659:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.040692:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121244.040735:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.040776:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfa480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121244.040795:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747008 00000100:00100000:0.0:1789121244.040802:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747008 00000100:00100000:0.0:1789121244.040914:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121244.040924:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+9:23408:x1876028970747008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121244.040939:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121244.040954:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e0e expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.040977:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 10 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.040985:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 10 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.040992:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ac600, rc 0) 00000100:00100000:0.0:1789121244.041025:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+10:23408:x1876028970747008:12345-0@lo:101:mount.lustre.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121244.041031:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121244.041050:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121244.041064:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.041073:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.041808:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747136:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789121244.041902:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.041933:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfa480 going to sleep for 11 seconds 00000100:00100000:3.0:1789121244.042014:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747136 00000100:00100000:3.0:1789121244.042021:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747136 00000100:00100000:3.0:1789121244.042060:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121244.042068:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+10:23408:x1876028970747136:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789121244.042086:0:23424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789121244.042093:0:23424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789121244.042444:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+10:23408:x1876028970747136:12345-0@lo:256:mount.lustre.0 Request processed in 375us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121244.042453:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789121244.042724:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747136:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789121244.044346:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789121244.044379:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.044392:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121244.045097:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468c076d800 from 1 10000000:01000000:0.0:1789121244.045102:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789121244.045169:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.045177:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.045187:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121244.045212:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121244.045280:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.045339:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121244.045452:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747264 00000100:00100000:1.0:1789121244.045460:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747264 00000100:00100000:1.0:1789121244.045528:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121244.045539:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+10:23408:x1876028970747264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121244.045674:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121244.045692:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e1c expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121244.045717:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 11 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121244.045729:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 11 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121244.045738:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2a00, rc 0) 00000100:00100000:1.0:1789121244.045801:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747264:12345-0@lo:101:mount.lustre.0 Request processed in 262us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121244.045809:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789121244.045982:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121244.045997:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.046007:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121244.046069:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121244.046094:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.046209:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747392 00000100:00100000:2.0:1789121244.046214:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747392 00000100:00100000:2.0:1789121244.046243:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121244.046249:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121244.046388:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747392:12345-0@lo:501:mount.lustre.0 Request processed in 138us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.046395:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789121244.046451:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121244.046464:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121244.046490:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121244.046646:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.046667:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.046713:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747520 00000100:00100000:2.0:1789121244.046717:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747520 00000100:00100000:2.0:1789121244.046747:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121244.046753:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121244.046855:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747520:12345-0@lo:503:mount.lustre.0 Request processed in 101us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.046861:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789121244.047015:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121244.047430:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23457:1876028970747648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121244.047471:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.047500:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.047656:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747648 00000100:00100000:2.0:1789121244.047661:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747648 00000100:00100000:2.0:1789121244.047688:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121244.047696:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23457:x1876028970747648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.048094:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23457:x1876028970747648:12345-0@lo:502:llog_process_th.0 Request processed in 398us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.048102:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121244.048260:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23457:1876028970747648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789121244.048285:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.048295:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.048297:0:23457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789121244.048305:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468c076d800 00000020:00000080:0.0:1789121244.048308:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121244.048315:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.048322:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.048324:0:23457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789121244.048326:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.048329:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.048330:0:23457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789121244.048333:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468c076d800 00000020:00000080:0.0:1789121244.048335:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121244.049265:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.049274:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.049276:0:23457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789121244.049279:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.049282:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.049283:0:23457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121244.049287:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c076d800 00000020:00000080:0.0:1789121244.049289:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121244.050399:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.050419:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050421:0:23457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121244.050425:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.050430:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050431:0:23457:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121244.050435:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c076d800 00000020:00000080:0.0:1789121244.050437:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121244.050470:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.050473:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050474:0:23457:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121244.050477:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.050479:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050480:0:23457:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121244.050484:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c076d800 00000020:00000080:0.0:1789121244.050486:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121244.050500:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.050503:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050516:0:23457:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121244.050520:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121244.050523:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.050524:0:23457:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789121244.050527:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c076d800 00000020:00000080:0.0:1789121244.050529:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789121244.050998:0:23457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23457:1876028970747776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121244.051087:0:23457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.052065:0:23457:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.052668:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747776 00000100:00100000:2.0:1789121244.052678:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747776 00000100:00100000:2.0:1789121244.052741:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121244.052751:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23457:x1876028970747776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.052932:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23457:x1876028970747776:12345-0@lo:502:llog_process_th.0 Request processed in 182us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.052940:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789121244.053683:0:23457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23457:1876028970747776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789121244.053715:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121244.053722:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121244.053724:0:23457:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789121244.053728:0:23457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789121244.054285:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789121244.054313:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121244.054339:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054351:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121244.054414:0:23408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789121244.054417:0:23408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9468c076d800 10000000:01000000:2.0:1789121244.054420:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9468c076d800 10000000:01000000:2.0:1789121244.054424:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789121244.054430:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468c076d800 from 1 10000000:01000000:2.0:1789121244.054432:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789121244.054468:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054485:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054495:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.054516:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121244.054574:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.054608:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.054634:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970747904 00000100:00100000:2.0:1789121244.054640:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970747904 00000100:00100000:2.0:1789121244.054675:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121244.054683:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23408:x1876028970747904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121244.054695:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121244.054707:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74e00/0xb74d2367a8310e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e2a expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054736:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74e00/0xb74d2367a8310e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e2a expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054746:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74e00/0xb74d2367a8310e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e2a expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054754:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74e00, rc 0) 00000100:00100000:2.0:1789121244.054787:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970747904:12345-0@lo:101:mount.lustre.0 Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.054794:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121244.054855:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970747904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121244.054869:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e31 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.054878:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e31 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.054921:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121244.054943:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.054958:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121244.058517:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748032 00000100:00100000:1.0:1789121244.058532:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748032 00000100:00100000:1.0:1789121244.058607:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789121244.058617:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121244.058849:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748032:12345-0@lo:501:mount.lustre.0 Request processed in 204us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121244.058858:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121244.058980:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121244.059046:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121244.059104:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.059150:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.059168:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748160 00000100:00100000:2.0:1789121244.059178:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748160 00000100:00100000:2.0:1789121244.059211:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121244.059217:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121244.059304:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748160:12345-0@lo:503:mount.lustre.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.059311:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121244.059352:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121244.086316:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789121244.086538:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121244.086655:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.086735:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748288 00000100:00100000:2.0:1789121244.086743:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748288 00000100:00100000:2.0:1789121244.086800:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121244.086811:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.086961:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748288:12345-0@lo:502:llog_process_th.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.086970:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789121244.087069:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748288:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789121244.087146:0:23459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789121244.087162:0:23459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff946783ca3490) 00000020:00000080:1.0:1789121244.087182:0:23459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789121244.087269:0:23459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c076d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789121244.087274:0:23459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468c076d800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789121244.087276:0:23459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468c076d800 4 00010000:00080000:1.0:1789121244.087309:0:23459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468a3a62800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121244.110116:0:23459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789121244.110340:0:23459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789121244.110390:0:23459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789121244.110418:0:23459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb74d2367a8310e3f 00000100:00080000:1.0:1789121244.110431:0:23459:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121244.110438:0:23459:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9468a3a62800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121244.110480:0:23459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b21c0 x1876028970748416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121244.110519:0:23459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789121244.110698:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970748416:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789121244.110781:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.112856:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748416 00000100:00100000:2.0:1789121244.112867:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748416 00000100:00100000:2.0:1789121244.112907:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121244.112917:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970748416:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121244.113025:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970748416:12345-0@lo:38:llog_process_th.0 Request processed in 108us (2243us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789121244.113033:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121244.113084:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121244.113093:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a3a62800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121244.113097:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789121244.113102:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970748416:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121244.128151:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.128247:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.128298:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748544 00000100:00100000:2.0:1789121244.128306:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748544 00000100:00100000:2.0:1789121244.128353:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121244.128363:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.128498:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748544:12345-0@lo:502:llog_process_th.0 Request processed in 136us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.130091:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121244.130174:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461240 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.130205:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.130272:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.130331:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.130366:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461240 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.132366:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748672 00000100:00100000:2.0:1789121244.132378:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748672 00000100:00100000:2.0:1789121244.132445:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121244.132457:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121244.132800:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23459:x1876028970748672:12345-0@lo:502:llog_process_th.0 Request processed in 344us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.132807:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121244.132887:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23459:1876028970748672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789121244.132922:0:23459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789121244.133231:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789121244.133252:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789121244.133273:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e31 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121244.133284:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e74400/0xb74d2367a8310e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e31 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789121244.133340:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789121244.133343:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789121244.133344:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121244.133345:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121244.133347:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121244.133348:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121244.133350:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121244.133351:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789121244.133353:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121244.133355:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121244.133359:0:23408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789121244.133361:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789121244.133362:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789121244.133363:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121244.133364:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121244.133365:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121244.133366:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121244.133367:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121244.133368:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789121244.133369:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121244.133370:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121244.133392:0:23408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789121244.133420:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789121244.133463:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.133780:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748800 00000100:00100000:2.0:1789121244.133787:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748800 00000100:00100000:2.0:1789121244.133851:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121244.133870:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121244.133894:0:23423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789121244.133906:0:23423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789121244.134036:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e2269c0 going to sleep for 11 seconds 20000000:01000000:2.0:1789121244.137905:0:23423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789121244.137930:0:23423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789121244.138766:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23408:x1876028970748800:12345-0@lo:253:mount.lustre.0 Request processed in 4892us (5295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.138779:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789121244.139083:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23408:1876028970748800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789121244.139100:0:23408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789121244.139110:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789121244.139112:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789121244.139114:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121244.139115:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121244.139116:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121244.139118:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121244.139119:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121244.139120:0:23408:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789121244.139123:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121244.139124:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789121244.139140:0:23408:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789121244.139487:0:23445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789121244.139492:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789121244.139516:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.139531:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 11 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.139540:0:23445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.139579:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 11 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121244.139617:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 11 pid: 23421 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121244.139632:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970748928:0@lo:104: 00000100:00100000:0.0:1789121244.139678:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121244.139723:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121244.140110:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970748928 00000100:00100000:2.0:1789121244.140118:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970748928 00000100:00100000:2.0:1789121244.140166:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121244.140177:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970748928:12345-0@lo:104: 00010000:00010000:2.0:1789121244.140191:0:23412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140244:0:23412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121244.140250:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970748928:12345-0@lo:104: Request processed in 76us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.140257:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121244.140289:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970748928:0@lo:104: 00010000:00010000:2.0:1789121244.140305:0:23445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140321:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121244.140327:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140333:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121244.140344:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140352:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121244.140360:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121244.140365:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789121244.140394:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140412:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121244.140432:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140439:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e15 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.140452:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121244.140454:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121244.140456:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121244.141108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970749056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121244.141148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121244.141225:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749056 00000100:00100000:2.0:1789121244.141229:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749056 00010000:00010000:2.0:1789121244.141251:0:23414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 12 pid: 23421 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.141281:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121244.141294:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:3647:x1876028970749056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121244.141305:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121244.141312:0:23414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 12 pid: 23421 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141322:0:23414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 12 pid: 23421 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141337:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310e0e expref: 12 pid: 23421 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141351:0:23414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141360:0:23414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789121244.141373:0:23414:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001881047s 00010000:00010000:2.0:1789121244.141377:0:23414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141384:0:23414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141391:0:23414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141397:0:23414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141411:0:23414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121244.141423:0:23414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141431:0:23414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141445:0:23414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141454:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121244.141500:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:3647:x1876028970749056:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121244.141515:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789121244.141538:0:23445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.141546:0:23445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121244.142690:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9ad000/0xb74d2367a8310e46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121244.142750:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970749056:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789121244.183678:0:23408:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789121244.185711:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789121244.185978:0:23471:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1789121244.185984:0:23471:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1789121244.186109:0:23472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789121244.186449:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1789121244.187216:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789121244.187260:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789121244.187815:0:23408:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789121244.187853:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789121244.187898:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121244.188168:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121244.194677:0:23408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789121244.196784:0:23408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:2.0:1789121244.197124:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789121244.197187:0:23472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:0.0:1789121244.198611:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789121244.200668:0:23408:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789121244.202367:0:23408:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000100:00080000:0.0:1789121244.207098:0:23473:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9467848fad00 x1876028970749184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121244.207114:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00000001:00000004:0.0:1789121244.217031:0:23408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789121244.221322:0:23408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789121244.221359:0:23408:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa04ac1c37988 00100000:10000000:0.0:1789121244.221366:0:23408:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789121244.222228:0:23408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789121244.222242:0:23408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789121244.222262:0:23408:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789121244.222281:0:23408:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789121244.222903:0:23408:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789121244.223432:0:23408:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789121244.757250:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789121245.079381:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789121245.079389:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468c076d800 from 11 10000000:01000000:3.0:1789121245.079404:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789121245.079459:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121245.079470:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121245.079481:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121245.079507:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970749312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121245.079577:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121245.079631:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789121245.079698:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749312 00000100:00100000:1.0:1789121245.079706:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749312 00000100:00100000:1.0:1789121245.079764:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789121245.079774:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+11:23426:x1876028970749312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121245.079789:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121245.079803:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e4d expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121245.079851:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 12 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121245.079863:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 12 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121245.079872:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789121245.079928:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23426:x1876028970749312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121245.079946:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789121245.079994:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970749312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121245.080009:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121245.080019:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121245.080069:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970749440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789121245.080101:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121245.080116:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121245.080129:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749440 00000100:00100000:1.0:1789121245.080133:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749440 00000100:00100000:1.0:1789121245.080155:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789121245.080162:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23426:x1876028970749440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789121245.080176:0:23423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789121245.080190:0:23423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789121245.080194:0:23423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789121245.080267:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:23426:x1876028970749440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121245.080275:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789121245.080304:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970749440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789121245.080342:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789121245.080349:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121245.080366:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789121245.202683:0:23468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789121245.202692:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789121245.217061:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789121245.217082:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789121245.265955:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:0.0:1789121245.780036:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789121246.226075:0:23468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789121246.226088:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789121246.226249:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789121246.226290:0:23468:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789121246.226455:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1789121246.290056:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:3.0:1789121246.810983:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121247.315772:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:0.0:1789121247.826091:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121248.338087:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00000001:02000400:2.0:1789121248.678928:0:23716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789121248.850031:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789121249.170183:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789121249.170190:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789121249.170194:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121249.170201:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:0.0:1789121249.170207:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121249.170225:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946886899000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121249.170247:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848f8b40 x1876028970749696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121249.171077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970749568:0@lo:400:kworker.0 00000100:00100000:1.0:1789121249.171150:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121249.171205:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749568 00000100:00100000:1.0:1789121249.171214:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749568 00000100:00100000:1.0:1789121249.171254:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121249.171263:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:3644:x1876028970749568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121249.171340:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:3644:x1876028970749568:12345-0@lo:400:kworker.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121249.171348:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121249.171405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970749568:0@lo:400:kworker.0 00000100:00080000:0.0:1789121249.175156:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121249.175163:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121249.175166:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121249.175169:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121249.175171:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789121249.175175:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789121249.175179:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a3a62800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121249.175192:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9468a3a62800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121249.175371:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848fb480 x1876028970749824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121249.175502:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970749696:0@lo:38:kworker.0 00000100:00100000:3.0:1789121249.175585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121249.175636:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970749824:0@lo:38:kworker.0 00000100:00100000:0.0:1789121249.175683:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749696 00000100:00100000:0.0:1789121249.175692:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749696 00000100:00100000:0.0:1789121249.175725:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121249.175732:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970749696:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789121249.175733:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1789121249.175753:0:23435:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789121249.175798:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970749696:12345-0@lo:38:kworker.0 Request processed in 64us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121249.175805:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121249.175832:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749824 00000100:00100000:3.0:1789121249.175842:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749824 00000100:00100000:3.0:1789121249.175878:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121249.175883:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970749824:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789121249.175899:0:23431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:3.0:1789121249.175932:0:23431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb74d2367a8310e5b 00000004:00100000:3.0:1789121249.175947:0:23431:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789121249.176077:0:23431:0:(import.c:65:import_set_state_nolock()) ffff9468a0876000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121249.176115:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876028970749824:12345-0@lo:38:kworker.0 Request processed in 231us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121249.176119:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789121249.176148:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121249.176152:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121249.176154:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970749696:0@lo:38:kworker.0 00010000:00080000:3.0:1789121249.176163:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9467848fb480 x1876028970749824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121249.176172:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789121249.176178:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789121249.176181:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789121249.176183:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a3a62800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121249.176186:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970749824:0@lo:38:kworker.0 00000100:00100000:0.0:1789121249.362989:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00000020:00000004:2.0:1789121249.529681:0:23768:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121249.530795:0:23768:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789121249.883768:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121250.389918:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00000020:00000004:2.0:1789121250.491777:0:23818:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121250.492757:0:23818:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121250.898291:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121251.410645:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:0.0:1789121251.922768:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121252.434951:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:3.0:1789121252.946314:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121253.458866:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:0.0:1789121253.971076:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121254.290432:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789121254.290440:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789121254.290444:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121254.290452:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 699 00000100:00080000:2.0:1789121254.290458:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789121254.290465:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946886899000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121254.290488:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebf840 x1876028970750080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121254.290511:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121254.290515:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121254.290517:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121254.290520:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121254.290577:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121244/real 1789121244] req@ffff9467848fb0c0 x1876028970746752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121254.290604:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9467848fb0c0 x1876028970746752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121254.290615:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121244/real 1789121244] req@ffff946891482940 x1876028970746624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121254.290627:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946891482940 x1876028970746624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121254.290671:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750080:0@lo:38:kworker.0 00000100:00100000:1.0:1789121254.290724:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121254.290738:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970749952:0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.290811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121254.290900:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749952 00000100:00100000:1.0:1789121254.290908:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749952 00000100:00100000:1.0:1789121254.290957:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121254.290967:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:3644:x1876028970749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.291019:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:3644:x1876028970749952:12345-0@lo:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121254.291046:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121254.291095:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970749952:0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.291134:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970750208:0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.291169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121254.291213:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750208 00000100:00100000:1.0:1789121254.291217:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750208 00000100:00100000:1.0:1789121254.291248:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121254.291255:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970750208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.291302:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970750208:12345-0@lo:400:kworker.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121254.291321:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789121254.291350:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946783ebe580 x1876028970750208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121254.291361:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970750208:0@lo:400:kworker.0 00000100:00100000:1.0:1789121254.292195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789121254.293277:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121254.293313:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121254.293319:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746752:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789121254.293326:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121254.293332:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121254.293336:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970746624:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789121254.293685:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121254.293691:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789121254.293695:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121254.293701:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:2.0:1789121254.293707:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121254.293714:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946784ac0000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121254.293755:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebc3c0 x1876028970750336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121254.293780:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121254.293783:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121254.293785:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121254.293788:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 694 00000100:00080000:2.0:1789121254.293791:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121254.293794:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121254.293806:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebf0c0 x1876028970750464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121254.293863:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750336:0@lo:8:kworker.0 00000400:00000100:2.0:1789121254.293923:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970750336 offset 0 length 520: 4 00000100:00100000:2.0:1789121254.293957:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750464:0@lo:8:kworker.0 00000400:00000100:2.0:1789121254.293979:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970750464 offset 0 length 520: 4 00000100:00100000:0.0:1789121254.300863:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750080 00000100:00100000:0.0:1789121254.300881:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750080 00000100:00100000:1.0:1789121254.301879:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121254.301889:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970750080:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789121254.301926:0:23435:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789121254.302114:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121254.302127:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121254.302133:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750080:0@lo:38:kworker.0 00000100:00100000:1.0:1789121254.302349:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970750080:12345-0@lo:38:kworker.0 Request processed in 133us (9830us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789121254.302358:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121254.482077:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:1.0:1789121254.994164:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121255.507586:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:0.0:1789121256.018620:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789121256.467223:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121256.532442:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:1.0:1789121257.043488:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121257.554852:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00000020:01000004:2.0:1789121257.917946:0:24163:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789121257.917956:0:24163:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789121257.917958:0:24163:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789121257.918085:0:24163:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946891f07000 00000020:01000004:2.0:1789121257.918102:0:24163:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789121257.918115:0:24163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789121257.918129:0:24163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9468c0874ed8) 00000020:00000080:2.0:1789121257.918145:0:24163:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789121258.023323:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.023863:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789121258.025029:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.025328:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.025537:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.025953:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.026147:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.026486:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.026665:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.026920:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.027143:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.027473:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.027665:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789121258.027877:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789121258.029033:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.029259:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.029469:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.029655:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.029787:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.030095:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.036885:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.037325:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.037602:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.037857:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.038107:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.038360:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.038627:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.038880:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.039103:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.039319:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.039542:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.039872:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.040117:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.040405:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.040679:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.040985:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.041244:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.041488:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.041681:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.042295:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.042537:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.042727:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.043478:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.043683:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789121258.045911:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789121258.046314:0:24163:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:3.0:1789121258.052550:0:24163:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789121258.052767:0:24163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789121258.052780:0:24163:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789121258.052792:0:24163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310e69 00000020:01000004:3.0:1789121258.052799:0:24163:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789121258.052859:0:24163:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789121258.052864:0:24163:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789121258.052878:0:24163:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789121258.052907:0:24163:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789121258.052911:0:24163:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789121258.063569:0:24163:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789121258.063624:0:24163:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789121258.063630:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789121258.063631:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789121258.063633:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121258.063634:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121258.063635:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121258.063642:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121258.063644:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789121258.063645:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121258.063647:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789121258.063651:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789121258.063653:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789121258.063654:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789121258.063655:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121258.063655:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121258.063656:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121258.063657:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121258.063658:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789121258.063659:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121258.063780:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789121258.063812:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789121258.063943:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789121258.064025:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.064130:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.066042:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750592 00000100:00100000:1.0:1789121258.066056:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750592 00000100:00100000:1.0:1789121258.066292:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121258.066305:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:24163:x1876028970750592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789121258.066344:0:23421:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789121258.066348:0:23421:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789121258.066355:0:23421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:0.0:1789121258.066757:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121258.066938:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:24163:x1876028970750592:12345-0@lo:253:mount.lustre.0 Request processed in 634us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.066947:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121258.067043:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789121258.067056:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789121258.067059:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789121258.067061:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789121258.067062:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121258.067064:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121258.067065:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121258.067066:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121258.067068:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789121258.067070:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121258.067071:0:24163:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789121258.067090:0:24163:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946891f07000 from lustre-MDT0001 10000000:01000000:0.0:1789121258.067120:0:24163:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789121258.067124:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789121258.067131:0:24163:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946882bf0000 local copy 00010000:00010000:0.0:1789121258.067141:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121258.067288:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121258.067330:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.074777:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.083682:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750720 00000100:00100000:3.0:1789121258.083699:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750720 00000100:00100000:3.0:1789121258.084703:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789121258.084715:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:24163:x1876028970750720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121258.084908:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:24163:x1876028970750720:12345-0@lo:501:mount.lustre.0 Request processed in 195us (17576us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789121258.084917:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789121258.085026:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750720:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789121258.085051:0:24163:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789121258.085077:0:24163:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789121258.085086:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085097:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121258.085131:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946891f07000 10000000:01000000:0.0:1789121258.085137:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789121258.085143:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff946882bf0000 10000000:01000000:0.0:1789121258.085146:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789121258.085150:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff946882bf0000 from 1 10000000:01000000:0.0:1789121258.085153:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789121258.085203:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085212:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085221:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121258.085262:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121258.085310:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.085350:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.085572:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750848 00000100:00100000:3.0:1789121258.085579:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750848 00000100:00100000:3.0:1789121258.085604:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121258.085610:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+12:24163:x1876028970750848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121258.085621:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121258.085638:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0a00/0xb74d2367a8310e77 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e70 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.085659:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0a00/0xb74d2367a8310e77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e70 expref: 13 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.085669:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0a00/0xb74d2367a8310e77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e70 expref: 13 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.085677:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0a00, rc 0) 00000100:00100000:3.0:1789121258.085719:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+13:24163:x1876028970750848:12345-0@lo:101:mount.lustre.0 Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.085726:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789121258.085816:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121258.085858:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e77 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085867:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e77 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121258.085884:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789121258.085900:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e77 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085907:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad000/0xb74d2367a8310e70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e77 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121258.085915:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946891f07000 10000000:01000000:0.0:1789121258.085918:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789121258.085922:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff946891f07000 from 1 10000000:01000000:0.0:1789121258.085924:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789121258.085940:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085947:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.085953:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121258.085973:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121258.086000:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.086015:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.086093:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970750976 00000100:00100000:3.0:1789121258.086097:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970750976 00000100:00100000:3.0:1789121258.086116:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789121258.086122:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+13:24163:x1876028970750976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121258.086129:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121258.086137:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1c00/0xb74d2367a8310e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e7e expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086151:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1c00/0xb74d2367a8310e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e7e expref: 14 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086158:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1c00/0xb74d2367a8310e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e7e expref: 14 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086164:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1c00, rc 0) 00000100:00100000:3.0:1789121258.086205:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+14:24163:x1876028970750976:12345-0@lo:101:mount.lustre.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.086211:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789121258.086351:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970750976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121258.086363:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e85 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.086372:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e85 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121258.086383:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789121258.086398:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e85 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.086405:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ad400/0xb74d2367a8310e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e85 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121258.086411:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789121258.086415:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789121258.086429:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946891f07000 10000000:01000000:0.0:1789121258.086432:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789121258.086435:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789121258.086437:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789121258.086452:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.086460:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.086473:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121258.086487:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121258.086512:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.086533:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.086650:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751104 00000100:00100000:3.0:1789121258.086654:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751104 00000100:00100000:3.0:1789121258.086673:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789121258.086679:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+14:24163:x1876028970751104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121258.086687:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121258.086694:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1400/0xb74d2367a8310e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310e8c expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086708:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1400/0xb74d2367a8310e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310e8c expref: 15 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086716:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1400/0xb74d2367a8310e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e8c expref: 15 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.086729:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1400, rc 0) 00000100:00100000:3.0:1789121258.086766:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751104:12345-0@lo:101:mount.lustre.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.086771:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789121258.087093:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121258.087105:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e93 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.087111:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310e93 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121258.088974:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1789121258.090112:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121258.098079:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789121258.098146:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1789121258.098163:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1789121258.098176:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1789121258.098545:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1789121258.098567:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1789121258.098581:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1789121258.098593:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1789121258.098607:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1789121258.098622:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1789121258.098638:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1789121258.098651:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1789121258.098663:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1789121258.098676:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1789121258.098703:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1789121258.098717:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1789121258.098731:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1789121258.098743:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1789121258.098755:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1789121258.098768:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1789121258.098782:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1789121258.098795:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1789121258.098809:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1789121258.098868:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1789121258.098886:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1789121258.098900:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1789121258.098912:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1789121258.098925:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1789121258.098937:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1789121258.098950:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1789121258.098965:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1789121258.098978:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1789121258.098990:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1789121258.099003:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1789121258.099016:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1789121258.099029:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1789121258.099041:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1789121258.099063:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1789121258.099079:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1789121258.099094:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1789121258.099107:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1789121258.099121:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1789121258.099138:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1789121258.099153:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1789121258.099182:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1789121258.099751:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1789121258.099934:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121258.100024:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.100112:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.103886:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751232 00000100:00100000:3.0:1789121258.103905:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751232 00000100:00100000:0.0:1789121258.104071:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789121258.104083:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121258.104397:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751232:12345-0@lo:501:mount.lustre.0 Request processed in 315us (4372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121258.104406:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121258.104909:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121258.104993:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121258.105050:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.105094:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946881370600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.105151:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751360 00000100:00100000:1.0:1789121258.105158:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751360 00000100:00100000:1.0:1789121258.105205:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789121258.105214:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121258.106485:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751360:12345-0@lo:503:mount.lustre.0 Request processed in 1266us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.106498:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121258.106660:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121258.107174:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121258.107401:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121258.107542:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.107588:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882c78180 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.107701:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751488 00000100:00100000:2.0:1789121258.107707:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751488 00000100:00100000:2.0:1789121258.107754:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789121258.107763:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.109286:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751488:12345-0@lo:502:mount.lustre.0 Request processed in 1509us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.109300:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121258.109557:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121258.109805:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789121258.109883:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789121258.109897:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789121258.109911:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789121258.109927:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789121258.109942:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789121258.109955:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789121258.109967:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789121258.109980:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789121258.110003:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789121258.110016:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789121258.110029:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789121258.110041:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789121258.110056:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789121258.110070:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789121258.110083:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789121258.110096:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789121258.110109:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789121258.110121:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789121258.110134:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789121258.110146:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789121258.110158:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789121258.110171:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789121258.110279:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789121258.110303:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789121258.110317:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789121258.110329:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789121258.110341:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789121258.110354:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789121258.110366:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789121258.110377:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789121258.110388:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789121258.110399:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789121258.110411:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789121258.110500:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789121258.110517:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789121258.110531:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789121258.110543:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789121258.110555:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789121258.110567:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789121258.110580:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789121258.110594:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789121258.110622:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789121258.110638:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789121258.110681:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121258.110750:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.110880:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946881370600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.112760:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751616 00000100:00100000:1.0:1789121258.112789:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751616 00000100:00100000:1.0:1789121258.112873:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789121258.112883:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121258.113062:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970751616:12345-0@lo:502:mount.lustre.0 Request processed in 180us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.113071:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121258.113278:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970751616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121258.113364:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1789121258.113378:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789121258.114207:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.114219:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.114222:0:24167:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789121258.114227:0:24167:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789121258.114229:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789121258.114253:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9468bfa9ced8) 00000020:00000080:2.0:1789121258.114285:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789121258.114292:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789121258.114385:0:24167:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789121258.114392:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310ea1 00000020:00000080:2.0:1789121258.114630:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789121258.114635:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.114639:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.114647:0:24167:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789121258.114650:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.114655:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.114656:0:24167:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789121258.114659:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789121258.114666:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9468bfa98000) 00000020:00000080:2.0:1789121258.114677:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789121258.114680:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789121258.114682:0:24167:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789121258.114685:0:24167:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789121258.114690:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789121258.114740:0:24167:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946891f07000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789121258.114752:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9468bfa99a48) 00000020:00000080:2.0:1789121258.114760:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789121258.114814:0:24167:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789121258.114973:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310eb6 00000020:00000080:2.0:1789121258.115076:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789121258.115084:0:24167:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789121258.115088:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb74d2367a8310ebd 00080000:01000000:2.0:1789121258.115094:0:24167:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789121258.115098:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310ec4 00010000:00010000:1.0:1789121258.224352:0:24167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1789121258.228696:0:24167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1789121258.229988:0:24167:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789121258.231361:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789121258.231373:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121258.231379:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.231381:0:24167:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789121258.231385:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121258.231391:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.231392:0:24167:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789121258.231395:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789121258.231400:0:24167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:1.0:1789121258.232186:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121258.232205:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff946783ca4ed8) 00000020:00000080:1.0:1789121258.232228:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789121258.232234:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789121258.232330:0:24167:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789121258.232337:0:24167:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789121258.232344:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310ed2 00010000:00080000:1.0:1789121258.232379:0:24167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468a0887000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121258.242155:0:24167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789121258.243382:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789121258.243396:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789121258.243448:0:24167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789121258.243473:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310ed9 00000100:00080000:1.0:1789121258.243483:0:24167:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121258.243489:0:24167:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9468a0887000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121258.243524:0:24167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b1e00 x1876028970751744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121258.243552:0:24167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789121258.243636:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970751744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121258.243711:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.243777:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751744 00000100:00100000:3.0:1789121258.243784:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751744 00000100:00100000:3.0:1789121258.243816:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121258.243841:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970751744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789121258.243865:0:23435:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:3.0:1789121258.243896:0:23435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310ee0 00000004:00100000:3.0:1789121258.243911:0:23435:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789121258.243917:0:23435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:1.0:1789121258.244426:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121258.244432:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244434:0:24167:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789121258.244437:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789121258.244440:0:24167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789121258.244441:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121258.244442:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121258.244444:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789121258.244446:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244447:0:24167:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789121258.244449:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121258.244454:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244462:0:24167:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789121258.244466:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789121258.244504:0:24167:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789121258.244523:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121258.244525:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244526:0:24167:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789121258.244529:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789121258.244531:0:24167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789121258.244532:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121258.244533:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121258.244535:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789121258.244537:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244538:0:24167:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789121258.244540:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789121258.244547:0:24167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789121258.244550:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121258.244551:0:24167:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789121258.244555:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789121258.244558:0:24167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:1.0:1789121258.244577:0:24167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789121258.244580:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121258.244592:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff946783ca1a48) 00000020:00000080:1.0:1789121258.244605:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789121258.244609:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789121258.244666:0:24167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789121258.244672:0:24167:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789121258.244677:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310eee 00010000:00080000:1.0:1789121258.244704:0:24167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468b98a2000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121258.244908:0:24167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1789121258.246056:0:24167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789121258.246962:0:24167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789121258.248565:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789121258.248573:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789121258.248577:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121258.248586:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:0.0:1789121258.248591:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789121258.248598:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946886899000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121258.248634:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848fbc00 x1876028970751872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121258.248666:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.248670:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121258.248674:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.248677:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789121258.248777:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121258.248796:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970752000:0@lo:400:kworker.0 00000100:00100000:3.0:1789121258.248964:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970751872:0@lo:38:kworker.0 00000100:00100000:3.0:1789121258.249034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.249109:0:23434:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789121258.249118:0:23434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789121258.249178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.249322:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752000 00000100:00100000:2.0:1789121258.249330:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752000 00000100:00100000:2.0:1789121258.249382:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789121258.249392:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970752000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121258.249466:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970752000:12345-0@lo:400:kworker.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.249474:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789121258.249513:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9467848f9680 x1876028970752000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121258.249538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970752000:0@lo:400:kworker.0 00000040:00080000:2.0:1789121258.252542:0:24167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121258.253038:0:24167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789121258.253203:0:24167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:1.0:1789121258.254301:0:23435:0:(import.c:65:import_set_state_nolock()) ffff9468b98a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121258.254412:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970751744:12345-0@lo:38:llog_process_th.0 Request processed in 10568us (10697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.254425:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1789121258.254444:0:24173:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789121258.254448:0:24173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1789121258.254450:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970751872 00000100:00100000:1.0:1789121258.254467:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970751872 00000100:00100000:1.0:1789121258.254489:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121258.254495:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970751872:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789121258.254539:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970751872:12345-0@lo:38:kworker.0 Request processed in 43us (5505us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789121258.254552:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121258.254593:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789121258.254600:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121258.254605:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789121258.254609:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970751872:0@lo:38:kworker.0 00000100:00100000:1.0:1789121258.254633:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789121258.254640:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789121258.254648:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789121258.254654:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789121258.254656:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0887000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789121258.254676:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970751744:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789121258.254863:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789121258.254878:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970752128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121258.254925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.254958:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752128 00000100:00100000:2.0:1789121258.254963:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752128 00000100:00100000:2.0:1789121258.254993:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121258.255001:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970752128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121258.255027:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789121258.255073:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970752128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.255081:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121258.255177:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970752128:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789121258.255745:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789121258.255759:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789121258.255802:0:24167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789121258.256007:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310ef5 00000100:00080000:3.0:1789121258.256017:0:24167:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121258.256022:0:24167:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468b98a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121258.256058:0:24167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946891481680 x1876028970752256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121258.256119:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970752256:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789121258.256157:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970752256 offset 0 length 520: 4 00000100:00080000:3.0:1789121258.256286:0:24167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789121258.256360:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121258.256365:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.256367:0:24167:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789121258.256370:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121258.256373:0:24167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789121258.256375:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121258.256376:0:24167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121258.256378:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121258.256381:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.256382:0:24167:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121258.256384:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789121258.256389:0:24167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789121258.256392:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.256393:0:24167:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789121258.256397:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789121258.256401:0:24167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:3.0:1789121258.256424:0:24167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789121258.256426:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121258.256440:0:24167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9468ab901a48) 00000020:00000080:3.0:1789121258.256453:0:24167:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000100:00080000:0.0:1789121258.256625:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.256637:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121258.256639:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.256642:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1789121258.256737:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789121258.256852:0:24167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789121258.256860:0:24167:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789121258.256866:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310f03 00010000:00080000:3.0:1789121258.256906:0:24167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468a0872000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121258.257072:0:24167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789121258.257125:0:24167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789121258.257137:0:24167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789121258.258654:0:24167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121258.258971:0:24167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789121258.259149:0:24167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789121258.259636:0:24175:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789121258.259641:0:24175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789121258.260650:0:24167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789121258.260663:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789121258.260704:0:24167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789121258.260733:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310f0a 00000100:00080000:3.0:1789121258.260744:0:24167:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121258.260749:0:24167:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121258.260785:0:24167:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946891482580 x1876028970752384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121258.260896:0:24167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789121258.260951:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970752384:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1789121258.260988:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121258.260992:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.260993:0:24167:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789121258.260996:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121258.260999:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.261001:0:24167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789121258.261004:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789121258.261005:0:24167:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789121258.261007:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121258.261010:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000400:00000100:1.0:1789121258.261010:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970752384 offset 0 length 520: 4 00000020:00000080:3.0:1789121258.261011:0:24167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789121258.261013:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121258.261015:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.261016:0:24167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789121258.261019:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789121258.261045:0:24167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121258.261047:0:24167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121258.261048:0:24167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789121258.261051:0:24167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1789121258.261113:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.261118:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121258.261120:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121258.261123:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789121258.261175:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1789121258.261207:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789121258.261226:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e93 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.261238:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ade00/0xb74d2367a8310e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310e93 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121258.261246:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946891f07000 from 1 10000000:01000000:1.0:1789121258.261248:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789121258.261292:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.261299:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.261308:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121258.261323:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121258.261360:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121258.261385:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121258.261443:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752512 00000100:00100000:0.0:1789121258.261449:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752512 00000100:00100000:0.0:1789121258.261508:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789121258.261519:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+15:24163:x1876028970752512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121258.261533:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121258.261545:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f11 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.261569:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 16 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.261581:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 16 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.261590:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9aca00, rc 0) 00000100:00100000:0.0:1789121258.261639:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:24163:x1876028970752512:12345-0@lo:101:mount.lustre.0 Request processed in 121us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121258.261646:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121258.261691:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121258.261715:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.261724:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121258.262501:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752640:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789121258.262555:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.262660:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a2d14540 going to sleep for 11 seconds 00000100:00100000:0.0:1789121258.263003:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752640 00000100:00100000:0.0:1789121258.263011:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752640 00000100:00100000:0.0:1789121258.263087:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789121258.263096:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:24163:x1876028970752640:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789121258.263113:0:23424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789121258.263130:0:23424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789121258.263133:0:23424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789121258.263474:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:24163:x1876028970752640:12345-0@lo:256:mount.lustre.0 Request processed in 378us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121258.263483:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789121258.263556:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752640:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789121258.264127:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789121258.264139:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.264151:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121258.264160:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946891f07000 from 1 10000000:01000000:3.0:1789121258.264162:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789121258.264526:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.264535:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.264545:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121258.264565:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121258.264670:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.264980:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a2d14540 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.265092:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752768 00000100:00100000:2.0:1789121258.265099:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752768 00000100:00100000:2.0:1789121258.265138:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789121258.265147:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:24163:x1876028970752768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121258.265160:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121258.265175:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f1f expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.265214:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.265225:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.265235:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74a00, rc 0) 00000100:00100000:2.0:1789121258.265298:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970752768:12345-0@lo:101:mount.lustre.0 Request processed in 153us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.265305:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789121258.265519:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121258.265534:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.265542:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121258.266882:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:3.0:1789121258.267172:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121258.267607:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789121258.267632:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1789121258.267648:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1789121258.267662:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1789121258.267677:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1789121258.267692:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1789121258.267707:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1789121258.267736:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:3.0:1789121258.267754:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:3.0:1789121258.267768:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:3.0:1789121258.267783:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:3.0:1789121258.267798:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:3.0:1789121258.267812:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:3.0:1789121258.267870:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:3.0:1789121258.267886:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:3.0:1789121258.267899:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:3.0:1789121258.267914:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:3.0:1789121258.267933:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:3.0:1789121258.267938:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:3.0:1789121258.268034:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121258.268112:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.268455:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.268619:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970752896 00000100:00100000:1.0:1789121258.268627:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970752896 00000100:00100000:2.0:1789121258.268696:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789121258.268710:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970752896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121258.268872:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970752896:12345-0@lo:501:mount.lustre.0 Request processed in 165us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.268881:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789121258.269030:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970752896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121258.269072:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121258.269116:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.269184:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.269239:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753024 00000100:00100000:1.0:1789121258.269243:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753024 00000100:00100000:1.0:1789121258.269261:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121258.269266:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121258.269369:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753024:12345-0@lo:503:mount.lustre.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.269376:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789121258.269514:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121258.269926:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121258.269999:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121258.270045:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.270072:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.270138:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753152 00000100:00100000:2.0:1789121258.270144:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753152 00000100:00100000:2.0:1789121258.270167:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789121258.270174:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.270295:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753152:12345-0@lo:502:mount.lustre.0 Request processed in 120us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.270302:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789121258.270436:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121258.270624:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789121258.270650:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1789121258.270666:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1789121258.270694:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1789121258.270711:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1789121258.270724:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1789121258.270735:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1789121258.270748:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:3.0:1789121258.270760:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:3.0:1789121258.270773:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:3.0:1789121258.270784:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:3.0:1789121258.270795:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:3.0:1789121258.270806:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:3.0:1789121258.270857:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:3.0:1789121258.270875:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:3.0:1789121258.270897:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:3.0:1789121258.270910:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:3.0:1789121258.270936:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121258.270975:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.271009:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.271153:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753280 00000100:00100000:2.0:1789121258.271159:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753280 00000100:00100000:2.0:1789121258.271189:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789121258.271196:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.271292:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753280:12345-0@lo:502:mount.lustre.0 Request processed in 95us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.271299:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789121258.271428:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121258.271472:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:3.0:1789121258.271480:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789121258.272376:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.272386:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.272388:0:24177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789121258.272395:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946891f07000 00000020:00000080:2.0:1789121258.272398:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.272472:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.272477:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.272479:0:24177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789121258.272482:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.272485:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.272487:0:24177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789121258.272490:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946891f07000 00000020:00000080:2.0:1789121258.272491:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.272580:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.272584:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.272586:0:24177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789121258.272588:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.272591:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.272592:0:24177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121258.272596:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946891f07000 00000020:00000080:2.0:1789121258.272598:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.274955:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.274968:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.274970:0:24177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121258.274974:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.274978:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.274979:0:24177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121258.274985:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946891f07000 00000020:00000080:2.0:1789121258.274987:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.275024:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.275027:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.275028:0:24177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121258.275031:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.275033:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.275034:0:24177:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121258.275037:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946891f07000 00000020:00000080:2.0:1789121258.275039:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.275054:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.275063:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.275064:0:24177:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121258.275066:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121258.275068:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.275069:0:24177:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789121258.275073:0:24177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946891f07000 00000020:00000080:2.0:1789121258.275074:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121258.275111:0:24177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121258.275114:0:24177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121258.275115:0:24177:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789121258.275118:0:24177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:2.0:1789121258.275939:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789121258.275986:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121258.282314:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.282333:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121258.282406:0:24163:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789121258.282409:0:24163:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946891f07000 10000000:01000000:2.0:1789121258.282413:0:24163:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946891f07000 10000000:01000000:2.0:1789121258.282934:0:24163:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789121258.282943:0:24163:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946891f07000 from 1 10000000:01000000:2.0:1789121258.282947:0:24163:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789121258.282990:0:24163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.283000:0:24163:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.283011:0:24163:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121258.283042:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121258.283116:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.283216:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121258.289312:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753408 00000100:00100000:0.0:1789121258.289327:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753408 00000100:00100000:0.0:1789121258.289667:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121258.289679:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:24163:x1876028970753408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121258.289701:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121258.289722:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ad200/0xb74d2367a8310f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f2d expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.289751:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ad200/0xb74d2367a8310f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f2d expref: 18 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.289763:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ad200/0xb74d2367a8310f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f2d expref: 18 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121258.289772:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ad200, rc 0) 00000100:00100000:0.0:1789121258.289886:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753408:12345-0@lo:101:mount.lustre.0 Request processed in 209us (6769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121258.289893:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789121258.289995:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121258.290016:0:24163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f34 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.290025:0:24163:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f34 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121258.303684:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1789121258.304037:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121258.304252:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1789121258.304288:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1789121258.304304:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1789121258.304317:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1789121258.304331:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1789121258.304347:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1789121258.304361:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1789121258.304374:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1789121258.304387:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1789121258.304400:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1789121258.304645:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1789121258.304661:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1789121258.304671:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1789121258.304682:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1789121258.304693:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1789121258.304704:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1789121258.304714:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1789121258.304726:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1789121258.304735:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1789121258.304746:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1789121258.304756:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1789121258.304767:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1789121258.304778:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1789121258.304788:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1789121258.304798:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1789121258.304809:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1789121258.304861:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1789121258.304877:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1789121258.304888:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1789121258.304901:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1789121258.304912:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1789121258.304924:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1789121258.304945:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1789121258.304958:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1789121258.304972:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1789121258.304984:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1789121258.304996:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1789121258.305008:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1789121258.305019:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1789121258.305029:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1789121258.305040:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1789121258.305051:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1789121258.305075:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1789121258.305090:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1789121258.305103:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1789121258.305115:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1789121258.305128:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1789121258.305141:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1789121258.305256:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1789121258.305290:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1789121258.305308:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1789121258.305313:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1789121258.305406:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121258.306643:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.309012:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.320328:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753536 00000100:00100000:3.0:1789121258.320344:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753536 00000100:00100000:3.0:1789121258.320398:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789121258.320409:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121258.320625:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753536:12345-0@lo:501:mount.lustre.0 Request processed in 217us (13985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.320633:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789121258.321180:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121258.321250:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121258.321311:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121258.321353:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.321359:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753664 00000100:00100000:2.0:1789121258.321364:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753664 00000100:00100000:2.0:1789121258.321404:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789121258.321412:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121258.321520:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753664:12345-0@lo:503:mount.lustre.0 Request processed in 108us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.321527:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789121258.321567:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789121258.322006:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789121258.322077:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.322118:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.322141:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753792 00000100:00100000:2.0:1789121258.322146:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753792 00000100:00100000:2.0:1789121258.322171:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789121258.322178:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.322284:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753792:12345-0@lo:502:mount.lustre.0 Request processed in 105us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.322291:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789121258.322322:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421780 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.322336:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121258.322493:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789121258.322525:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789121258.322538:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789121258.322549:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789121258.322561:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789121258.322573:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789121258.322585:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789121258.322609:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789121258.322621:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789121258.322632:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789121258.322642:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789121258.322653:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789121258.322664:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789121258.322675:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789121258.322685:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789121258.322696:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789121258.322707:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789121258.322718:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789121258.322728:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789121258.322739:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789121258.322750:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789121258.322760:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789121258.322771:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789121258.322797:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789121258.322813:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789121258.322852:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789121258.322866:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789121258.322879:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789121258.322892:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789121258.322904:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789121258.322917:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789121258.322928:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789121258.322941:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789121258.322953:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789121258.322977:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789121258.322990:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789121258.323002:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789121258.323016:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789121258.323027:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789121258.323054:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789121258.323069:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789121258.323082:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789121258.323093:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789121258.323105:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789121258.323117:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789121258.323129:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789121258.323141:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789121258.323153:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789121258.323191:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.323248:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.323288:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421780 going to sleep for 11 seconds 00000100:00100000:1.0:1789121258.323694:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970753920 00000100:00100000:1.0:1789121258.323700:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970753920 00000100:00100000:1.0:1789121258.323743:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789121258.323751:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121258.324031:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970753920:12345-0@lo:502:mount.lustre.0 Request processed in 279us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.324038:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121258.325485:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970753920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121258.325700:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1789121258.325728:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1789121258.325769:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970754048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121258.325850:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.325888:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835da240 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.326049:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754048 00000100:00100000:2.0:1789121258.326055:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754048 00000100:00100000:2.0:1789121258.326109:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789121258.326118:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970754048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121258.326525:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970754048:12345-0@lo:502:mount.lustre.0 Request processed in 406us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.326533:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789121258.328374:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970754048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121258.328545:0:24163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1789121258.328558:0:24163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789121258.331965:0:24184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789121258.331985:0:24184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9468bfa9b490) 00000020:00000080:2.0:1789121258.332011:0:24184:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789121258.332107:0:24184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946891f07000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789121258.332112:0:24184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946891f07000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789121258.332115:0:24184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946891f07000 3 00010000:00080000:2.0:1789121258.332153:0:24184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946782aef800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789121258.337918:0:24184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789121258.339746:0:24184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789121258.340801:0:24184:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789121258.340830:0:24184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb74d2367a8310f42 00000100:00080000:2.0:1789121258.340843:0:24184:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121258.340849:0:24184:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff946782aef800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121258.340886:0:24184:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebfc00 x1876028970754176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121258.340919:0:24184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789121258.340949:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121258.340955:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121258.340958:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121258.340960:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789121258.341291:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970754176:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789121258.341668:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121258.342723:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754176 00000100:00100000:1.0:1789121258.342733:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754176 00000100:00100000:1.0:1789121258.342931:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121258.342940:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970754176:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789121258.342972:0:23429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 708 last 0 00000020:00000080:1.0:1789121258.343012:0:23429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb74d2367a8310f49 00000004:00100000:1.0:1789121258.343029:0:23429:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789121258.343304:0:23429:0:(import.c:65:import_set_state_nolock()) ffff9468a0881000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121258.343459:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876028970754176:12345-0@lo:38:llog_process_th.0 Request processed in 517us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121258.343468:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789121258.343525:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946783ebfc00 x1876028970754176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121258.343549:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789121258.343559:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789121258.343567:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789121258.343572:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789121258.343574:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782aef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789121258.343581:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970754176:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789121258.344601:0:24184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1789121258.344858:0:24163:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789121258.344888:0:24163:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789121258.344914:0:24163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f34 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.344925:0:24163:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e75000/0xb74d2367a8310f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f34 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789121258.344991:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789121258.344994:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789121258.344996:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789121258.344997:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789121258.344998:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789121258.345000:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789121258.345002:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789121258.345005:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789121258.345006:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789121258.345010:0:24163:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789121258.345013:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789121258.345015:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789121258.345016:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789121258.345018:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789121258.345019:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789121258.345021:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789121258.345022:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789121258.345023:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789121258.345025:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789121258.345049:0:24163:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789121258.345068:0:24163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970754304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789121258.345131:0:24163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.345175:0:24163:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882fc3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.345278:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754304 00000100:00100000:2.0:1789121258.345285:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754304 00000100:00100000:2.0:1789121258.345331:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789121258.345342:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970754304:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121258.345368:0:23423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789121258.345381:0:23423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789121258.351663:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789121258.351771:0:23423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789121258.351797:0:23423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789121258.352122:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24163:x1876028970754304:12345-0@lo:253:mount.lustre.0 Request processed in 6777us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.352135:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789121258.352205:0:24163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24163:1876028970754304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121258.352232:0:24163:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789121258.352237:0:24163:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121258.352238:0:24163:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789121258.352240:0:24163:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121258.352242:0:24163:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121258.352244:0:24163:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121258.352245:0:24163:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121258.352247:0:24163:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121258.352249:0:24163:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121258.352251:0:24163:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789121258.352289:0:24163:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789121258.354783:0:23445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789121258.354792:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789121258.354816:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.354868:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.354875:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.354883:0:23445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.354923:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.354939:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121258.354955:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914821c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970754432:0@lo:104: 00000100:00100000:3.0:1789121258.355025:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789121258.355080:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.355088:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121258.355097:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970754560:0@lo:104: 00000100:00100000:3.0:1789121258.355120:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.355135:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.355235:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754432 00000100:00100000:2.0:1789121258.355244:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754432 00000100:00100000:2.0:1789121258.355289:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754560 00000100:00100000:2.0:1789121258.355292:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754560 00000100:00100000:2.0:1789121258.355306:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789121258.355314:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970754432:12345-0@lo:104: 00010000:00010000:2.0:1789121258.355327:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.355387:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121258.355394:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970754432:12345-0@lo:104: Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.355401:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789121258.355414:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121258.355423:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.355432:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121258.355436:0:23417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.355444:0:23417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121258.355452:0:23417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121258.355458:0:23417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789121258.355491:0:23417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.355499:0:23417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121258.355523:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.355542:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f18 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121258.355556:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121258.355558:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121258.355562:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121258.355583:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970754688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121258.355676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.357195:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121258.357210:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970754560:12345-0@lo:104: 00010000:00010000:2.0:1789121258.357225:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.357310:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121258.357317:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970754560:12345-0@lo:104: Request processed in 113us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.357330:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121258.357363:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754688 00000100:00100000:2.0:1789121258.357370:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754688 00010000:00010000:2.0:1789121258.357391:0:23414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 18 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358327:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121258.358337:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358358:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121258.358363:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358373:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121258.358380:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121258.358386:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789121258.358551:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789121258.358563:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3645:x1876028970754688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121258.358577:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121258.358583:0:23414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 18 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.358595:0:23414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 18 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.358614:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121258.358674:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3645:x1876028970754688:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.358682:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789121258.358768:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358775:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121258.358797:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358803:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e54 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121258.358817:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121258.358842:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121258.358844:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121258.360023:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8310f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f11 expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121258.360041:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914821c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970754432:0@lo:104: 00000100:00100000:3.0:1789121258.360054:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970754560:0@lo:104: 00010000:00010000:3.0:1789121258.360095:0:23445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121258.360885:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970754688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121258.360916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970754816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121258.360976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121258.361030:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754816 00000100:00100000:2.0:1789121258.361035:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754816 00010000:00010000:2.0:1789121258.361063:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121258.361088:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121258.361103:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:3646:x1876028970754816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121258.361115:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121258.361120:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361131:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361148:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310e4d expref: 17 pid: 23421 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361162:0:23416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361170:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789121258.361185:0:23416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006394053s 00010000:00010000:2.0:1789121258.361189:0:23416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361197:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361205:0:23416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361211:0:23416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361217:0:23416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121258.361225:0:23416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361234:0:23416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361248:0:23416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361257:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121258.361302:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:3646:x1876028970754816:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.361310:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121258.361343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970754816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121258.361359:0:23445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361367:0:23445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121258.361374:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0400/0xb74d2367a8310f50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1789121258.369578:0:24163:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789121258.369854:0:24191:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789121258.369858:0:24191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789121258.370052:0:24192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789121258.370390:0:24163:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1789121258.370873:0:24163:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789121258.370911:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789121258.371349:0:24163:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789121258.371356:0:24163:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789121258.371392:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121258.371624:0:24192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121258.376692:0:24163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789121258.377349:0:24192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789121258.377406:0:24192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1789121258.377796:0:24163:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789121258.377862:0:24163:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1789121258.377968:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970754944:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789121258.377977:0:24163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121258.378057:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.378217:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.378262:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970754944 00000100:00100000:3.0:1789121258.378283:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970754944 00000100:00100000:3.0:1789121258.378348:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121258.378359:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970754944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789121258.378540:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970754944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 182us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.378548:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121258.379339:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970754944:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789121258.379378:0:24193:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789121258.379417:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970755072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789121258.379479:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121258.379520:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93000 going to sleep for 11 seconds 00000100:00100000:3.0:1789121258.379595:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755072 00000100:00100000:3.0:1789121258.379601:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755072 00000100:00100000:3.0:1789121258.379645:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121258.379652:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970755072:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789121258.379784:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970755072:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121258.379791:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121258.379875:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970755072:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121258.379941:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24193:1876028970755200:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789121258.379973:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121258.379990:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6600 going to sleep for 11 seconds 00080000:10000000:2.0:1789121258.379992:0:24163:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1789121258.380210:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755200 00000100:00100000:0.0:1789121258.380216:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755200 00000100:00100000:0.0:1789121258.380250:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789121258.380259:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24193:x1876028970755200:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789121258.380324:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24193:x1876028970755200:12345-0@lo:900:lod0001_rec0000.0 Request processed in 67us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121258.380331:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789121258.380701:0:24193:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9468b99b12c0 x1876028970755200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121258.380714:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24193:1876028970755200:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789121258.380771:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970755328:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789121258.380817:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121258.380858:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121258.382449:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755328 00000100:00100000:2.0:1789121258.382462:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755328 00000100:00100000:2.0:1789121258.382523:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121258.382534:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970755328:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789121258.382682:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24193:x1876028970755328:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 150us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121258.382691:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121258.387162:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24193:1876028970755328:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789121258.387253:0:24193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1789121258.390722:0:24163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1789121258.392102:0:24193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789121258.392180:0:24193:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789121258.392186:0:24193:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1789121258.393649:0:24163:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789121258.393684:0:24163:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa04ac163f988 00100000:10000000:1.0:1789121258.393691:0:24163:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789121258.397702:0:24163:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789121258.397756:0:24163:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789121258.397779:0:24163:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789121258.397798:0:24163:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789121258.407616:0:24163:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789121258.407876:0:24163:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789121258.581008:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:1.0:1789121259.090948:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121259.350658:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789121259.475311:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789121259.475324:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946891f07000 from 12 10000000:01000000:0.0:1789121259.475331:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789121259.475398:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121259.475571:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121259.475585:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121259.475613:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121259.475688:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121259.476374:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755456 00000100:00100000:3.0:1789121259.476384:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755456 00000100:00100000:3.0:1789121259.477159:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789121259.477171:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:23426:x1876028970755456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121259.477186:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121259.477204:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f57 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.477228:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 17 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.477239:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 17 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.477248:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0e00, rc 0) 00000100:00100000:3.0:1789121259.484304:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970755456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7125us (8604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121259.484320:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789121259.484754:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121259.484785:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121259.484812:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121259.484844:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121259.484928:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789121259.484981:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121259.485002:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:2.0:1789121259.488221:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755584 00000100:00100000:2.0:1789121259.488237:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755584 00000100:00100000:2.0:1789121259.488319:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789121259.488330:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970755584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789121259.488360:0:23423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789121259.488385:0:23423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789121259.488388:0:23423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789121259.488539:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970755584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 210us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121259.488547:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789121259.488814:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789121259.488915:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789121259.488925:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121259.488936:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121259.488957:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789121259.488960:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468c076d800 from 12 10000000:01000000:1.0:1789121259.488963:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789121259.488995:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121259.489003:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121259.489012:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121259.489044:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121259.489334:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121259.489377:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789121259.489395:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755712 00000100:00100000:3.0:1789121259.489401:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755712 00000100:00100000:3.0:1789121259.489452:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789121259.489460:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970755712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121259.489472:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121259.489485:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f65 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.489507:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 18 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.489526:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 18 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.489535:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1a00, rc 0) 00000100:00100000:3.0:1789121259.489584:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970755712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121259.489591:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789121259.489596:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121259.489609:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121259.489618:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121259.489668:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121259.489700:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121259.489722:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789121259.489975:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755840 00000100:00100000:3.0:1789121259.489979:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755840 00000100:00100000:3.0:1789121259.490005:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789121259.490010:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970755840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789121259.490023:0:23423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789121259.490036:0:23423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789121259.490040:0:23423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1789121259.490107:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970755840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121259.490114:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789121259.490144:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970755840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789121259.490251:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789121259.490267:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121259.490274:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121259.614701:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:3.0:1789121260.113966:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789121260.371140:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789121260.635498:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:1.0:1789121261.139873:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121261.650286:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:2.0:1789121262.161987:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121262.675195:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 0 seconds 00010000:00010000:1.0:1789121263.187415:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789121263.389357:0:24437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789121263.507064:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121263.507088:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970755968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121263.507172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121263.507262:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970755968 00000100:00100000:0.0:1789121263.507271:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970755968 00000100:00100000:0.0:1789121263.507339:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121263.507350:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970755968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121263.507392:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789121263.507448:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970755968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121263.507456:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121263.507510:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970755968:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789121263.508018:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789121263.508024:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789121263.508027:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121263.508035:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946886899000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121263.508056:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b1680 x1876028970756224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121263.508075:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121263.508078:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121263.508095:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121263.508097:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121263.508111:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121263.508114:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121263.508116:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121263.508118:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789121263.508171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970756352:0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.508212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121263.508249:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121263.508256:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970756096:0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.508283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121263.508771:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756352 00000100:00100000:1.0:1789121263.508778:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756352 00000100:00100000:1.0:1789121263.508815:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121263.508848:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970756352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.508898:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970756352:12345-0@lo:400:kworker.0 Request processed in 51us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121263.508905:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121263.508929:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756096 00000100:00100000:1.0:1789121263.508932:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756096 00000100:00100000:1.0:1789121263.508957:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789121263.508965:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3645:x1876028970756096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.508999:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3645:x1876028970756096:12345-0@lo:400:kworker.0 Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121263.509019:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789121263.509132:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789121263.509143:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970756480:0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.509792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121263.509875:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970756224:0@lo:38:kworker.0 00000100:00100000:0.0:1789121263.509910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121263.509954:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756224 00000100:00100000:0.0:1789121263.509959:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756224 00000100:00100000:0.0:1789121263.509984:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121263.509989:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970756224:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789121263.510015:0:23434:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:0.0:1789121263.510060:0:23434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310f73 00000004:00100000:0.0:1789121263.510077:0:23434:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789121263.510084:0:23434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789121263.511522:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756480 00000100:00100000:3.0:1789121263.511533:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756480 00000100:00100000:3.0:1789121263.511624:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121263.511633:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970756480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121263.511709:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970756480:12345-0@lo:400:kworker.0 Request processed in 78us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.511717:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789121263.511971:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99b03c0 x1876028970756480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121263.511986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970756480:0@lo:400:kworker.0 00000100:00100000:1.0:1789121263.512026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970756096:0@lo:400:kworker.0 00010000:00080000:1.0:1789121263.512039:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99b2940 x1876028970756352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121263.512049:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970756352:0@lo:400:kworker.0 00000100:00080000:3.0:1789121263.519855:0:23434:0:(import.c:65:import_set_state_nolock()) ffff946782aea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121263.519973:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970756224:12345-0@lo:38:kworker.0 Request processed in 9981us (10060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.519985:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789121263.522895:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789121263.522912:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789121263.522919:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789121263.522923:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946886899000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789121263.522956:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000065b2a871): req@ffff9467848fad00 x1876028970749184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121263.522978:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970756224:0@lo:38:kworker.0 00000100:00100000:3.0:1789121263.523203:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121263.523242:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789121263.523261:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970749184 00000100:00100000:3.0:1789121263.523266:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970749184 00000100:00100000:3.0:1789121263.523322:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121263.523331:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23473:x1876028970749184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.523418:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23473:x1876028970749184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.523425:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121263.523452:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23473:1876028970749184:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789121263.523496:0:23473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789121263.523527:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23473:1876028970756736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.523552:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121263.523566:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121263.523585:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121263.523593:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970756608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121263.523614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121263.523632:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756736 00000100:00100000:3.0:1789121263.523635:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756736 00000100:00100000:3.0:1789121263.523647:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756608 00000100:00100000:3.0:1789121263.523649:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756608 00000100:00100000:3.0:1789121263.523660:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121263.523665:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23473:x1876028970756736:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.523756:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23473:x1876028970756736:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.523763:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121263.523776:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121263.523781:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970756608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121263.523802:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121263.523869:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970756608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.523876:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121263.523908:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23473:1876028970756736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.523975:0:23473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23473:1876028970756864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.523999:0:23473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121263.524012:0:23473:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789121263.524034:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970756608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121263.524048:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756864 00000100:00100000:3.0:1789121263.524052:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756864 00000100:00100000:3.0:1789121263.524072:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789121263.524084:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23473:x1876028970756864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121263.524129:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23473:x1876028970756864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121263.524135:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789121263.524160:0:23473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23473:1876028970756864:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1789121263.524197:0:23473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121263.526162:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789121263.534710:0:23473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1789121263.534724:0:23473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789121264.221108:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789121264.401321:0:24489:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121264.402485:0:24489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789121265.234059:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789121265.460590:0:24539:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121265.461419:0:24539:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789121266.258167:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789121266.439665:0:24587:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeea998970 20000000:00000080:2.0:1789121266.439682:0:24587:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468aae5e800 uarg=0000000000000000 20000000:01000000:2.0:1789121266.439716:0:24587:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789121266.439722:0:24587:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789121266.439726:0:24587:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789121266.440435:0:24588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:2.0:1789121266.440578:0:24587:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789121266.445738:0:24587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789121266.445767:0:24587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.445783:0:24587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.445800:0:24587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.445806:0:24587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.445881:0:24587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.445897:0:24587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121266.446245:0:24587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24587:1876028970756992:0@lo:104: 00000100:00100000:2.0:1789121266.446318:0:24587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789121266.446384:0:24587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.446394:0:24587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121266.446404:0:24587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24587:1876028970757120:0@lo:104: 00000100:00100000:2.0:1789121266.446422:0:24587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121266.446447:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970756992 00000100:00100000:2.0:1789121266.446454:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970756992 00000100:00100000:2.0:1789121266.446484:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757120 00000100:00100000:2.0:1789121266.446486:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757120 00000100:00100000:2.0:1789121266.446586:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121266.446599:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:24587:x1876028970756992:12345-0@lo:104: 00010000:00010000:2.0:1789121266.446612:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121266.446656:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121266.446662:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:24587:x1876028970756992:12345-0@lo:104: Request processed in 67us (345us total) trans 0 rc 0/0 00010000:00010000:1.0:1789121266.447419:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121266.447427:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.447436:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121266.447440:0:23417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.447449:0:23417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121266.447456:0:23417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121266.447476:0:23417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789121266.447527:0:23417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.447533:0:23417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121266.447556:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.447563:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0200/0xb74d2367a8310f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f26 expref: -99 pid: 24163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.447575:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121266.447577:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121266.447579:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121266.447817:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970757248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121266.447888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121266.447949:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757248 00000100:00100000:1.0:1789121266.447954:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757248 00010000:00010000:1.0:1789121266.447979:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 18 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121266.448005:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121266.448014:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3644:x1876028970757248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121266.448026:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121266.448031:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 18 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.448041:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 18 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121266.448065:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121266.448096:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3644:x1876028970757248:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121266.448103:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121266.448148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970757248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121266.448755:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121266.448777:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121266.448788:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:24587:x1876028970757120:12345-0@lo:104: 00010000:00010000:2.0:1789121266.448801:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121266.448894:0:24587:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99dc00 going to sleep for 11 seconds 00010000:00010000:3.0:1789121266.449115:0:24587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e74a00/0xb74d2367a8310f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f1f expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121266.449127:0:24587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24587:1876028970756992:0@lo:104: 00010000:00010000:2.0:1789121266.449256:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121266.449263:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:24587:x1876028970757120:12345-0@lo:104: Request processed in 479us (2839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121266.449271:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789121266.449317:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121266.449324:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449332:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ada00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121266.449336:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449345:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121266.449353:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121266.449372:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789121266.449411:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449418:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121266.449442:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449449:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8310e1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310e23 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449463:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121266.449464:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121266.449466:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121266.449516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121266.449529:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970757376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121266.449566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121266.449852:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757376 00000100:00100000:0.0:1789121266.449860:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757376 00010000:00010000:0.0:1789121266.449884:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121266.449917:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121266.449924:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:3644:x1876028970757376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121266.449935:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121266.449939:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449948:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 17 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449965:0:23415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449980:0:23415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.449995:0:23415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450001:0:23415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450008:0:23415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450014:0:23415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450019:0:23415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121266.450022:0:23415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450029:0:23415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450037:0:23415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121266.450046:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121266.450082:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:3644:x1876028970757376:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121266.450088:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121266.450223:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970757376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121266.450393:0:24587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2a00/0xb74d2367a8310e23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310e1c expref: 16 pid: 23421 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121266.450403:0:24587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24587:1876028970757120:0@lo:104: 00010000:00010000:3.0:1789121266.450422:0:24587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121266.450432:0:24587:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121266.450437:0:24587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121266.450444:0:24587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e75800/0xb74d2367a8310f7a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121266.709313:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789121267.281991:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789121267.872349:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789121267.872359:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946891f07000 from 19 10000000:01000000:1.0:1789121267.872365:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789121267.872417:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121267.872431:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121267.872443:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121267.872470:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121267.877895:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121267.877955:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1789121267.880647:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757504 00000100:00100000:0.0:1789121267.880661:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757504 00000100:00100000:0.0:1789121267.880714:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789121267.880724:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+16:23426:x1876028970757504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121267.880743:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121267.880764:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f81 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121267.880790:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121267.880802:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 17 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121267.880812:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ac600, rc 0) 00000100:00100000:0.0:1789121267.880905:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121267.880912:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789121267.881201:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121267.881230:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121267.881240:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121267.883322:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121267.883754:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121267.883802:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789121267.886457:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757632 00000100:00100000:2.0:1789121267.886470:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757632 00000100:00100000:2.0:1789121267.886524:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121267.886609:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121267.886767:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121267.886774:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789121267.892916:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121267.892983:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121267.893057:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121267.893092:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789121267.893210:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757760 00000100:00100000:1.0:1789121267.893216:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757760 00000100:00100000:1.0:1789121267.893264:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121267.893273:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121267.893398:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121267.893406:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121267.893455:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789121267.896117:0:24649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121267.896465:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121267.896485:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121267.896496:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896509:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121267.896520:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789121267.896523:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468c076d800 from 19 10000000:01000000:3.0:1789121267.896525:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789121267.896578:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896586:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896596:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121267.896623:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.896693:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121267.896731:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121267.896758:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970757888 00000100:00100000:3.0:1789121267.896764:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970757888 00000100:00100000:3.0:1789121267.896809:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789121267.896835:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+17:23426:x1876028970757888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121267.896850:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121267.896874:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310f8f expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896898:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 18 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896909:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 18 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.896918:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1000, rc 0) 00000100:00100000:3.0:1789121267.896957:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970757888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121267.896964:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789121267.897014:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970757888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121267.897027:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.897036:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121267.897094:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970758016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.897120:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121267.897139:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121267.897151:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758016 00000100:00100000:3.0:1789121267.897154:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758016 00000100:00100000:3.0:1789121267.897174:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789121267.897193:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970758016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.897299:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970758016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121267.897313:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789121267.897357:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970758016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.897384:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970758144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.897420:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121267.897433:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121267.897445:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758144 00000100:00100000:3.0:1789121267.897448:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758144 00000100:00100000:3.0:1789121267.897469:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789121267.897474:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970758144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121267.897544:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:23426:x1876028970758144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121267.897551:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789121267.897587:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970758144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789121267.898239:0:24650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121267.898302:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121267.898323:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121267.898330:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121267.898339:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121268.311454:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121268.626023:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789121268.626047:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970758272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121268.626133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121268.626195:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758272 00000100:00100000:2.0:1789121268.626203:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758272 00000100:00100000:2.0:1789121268.626254:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121268.626287:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970758272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121268.626329:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789121268.626381:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970758272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121268.626388:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121268.626438:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970758272:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789121268.626700:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.626705:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121268.626708:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.626710:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121268.626730:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.626734:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121268.626737:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.626740:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121268.626764:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970758528:0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.626810:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121268.626852:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121268.626858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970758656:0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.626885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121268.626916:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758528 00000100:00100000:2.0:1789121268.626921:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758528 00000100:00100000:2.0:1789121268.626949:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758656 00000100:00100000:2.0:1789121268.626952:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758656 00000100:00100000:2.0:1789121268.626966:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121268.626981:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970758528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.627022:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970758528:12345-0@lo:400:kworker.0 Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121268.627028:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121268.627040:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121268.627046:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970758656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.627070:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970758656:12345-0@lo:400:kworker.0 Request processed in 24us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121268.627088:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789121268.627123:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946783ebcb40 x1876028970758656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121268.627136:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970758656:0@lo:400:kworker.0 00010000:00080000:2.0:1789121268.627146:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946783ebcf00 x1876028970758528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121268.627154:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970758528:0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.627184:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970758400:0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.627212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121268.629337:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121258/real 1789121258] req@ffff946891482580 x1876028970752384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121268.629366:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946891482580 x1876028970752384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121268.629388:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121258/real 1789121258] req@ffff946891481680 x1876028970752256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121268.629399:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946891481680 x1876028970752256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121268.629417:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121268.629431:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121268.629435:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970752384:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789121268.629441:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468b98a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121268.629446:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121268.629449:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970752256:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789121268.629589:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.629594:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121268.629597:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.629600:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121268.629603:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.629605:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789121268.629614:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468b98a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121268.629619:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 708 00000100:00080000:2.0:1789121268.629624:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121268.629630:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468b98a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121268.629652:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebde00 x1876028970758912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121268.629667:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121268.629670:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121268.629672:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121268.629674:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 708 00000100:00080000:2.0:1789121268.629677:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121268.629680:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121268.629690:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783ebd2c0 x1876028970759040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121268.629715:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970758912:0@lo:8:kworker.0 00000400:00000100:2.0:1789121268.629764:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970758912 offset 0 length 520: 4 00000100:00100000:2.0:1789121268.629802:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970759040:0@lo:8:kworker.0 00000400:00000100:2.0:1789121268.629845:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970759040 offset 0 length 520: 4 00000100:00100000:2.0:1789121268.629868:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789121268.629877:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970758784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121268.629908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121268.629936:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758400 00000100:00100000:2.0:1789121268.629943:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758400 00000100:00100000:2.0:1789121268.629983:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970758784 00000100:00100000:2.0:1789121268.629986:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970758784 00000100:00100000:2.0:1789121268.630017:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121268.630026:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970758400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121268.630084:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970758400:12345-0@lo:400:kworker.0 Request processed in 57us (2870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121268.630092:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121268.630109:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121268.630116:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970758784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121268.630142:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121268.630189:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970758784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121268.630196:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121268.630243:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970758784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121268.630255:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970758400:0@lo:400:kworker.0 00010000:00010000:1.0:1789121269.329923:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121269.649916:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121254/real 1789121254] req@ffff946783ebc3c0 x1876028970750336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121269.650007:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783ebc3c0 x1876028970750336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121269.650017:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121254/real 1789121254] req@ffff946783ebf0c0 x1876028970750464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121269.650027:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783ebf0c0 x1876028970750464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789121269.650048:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121269.650156:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121269.650174:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750336:0@lo:8:kworker.0 00000100:00080000:2.0:1789121269.650191:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121269.650294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.650299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789121269.650308:0:37:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121269.650313:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:1.0:1789121269.650320:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789121269.650327:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946784ac0000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121269.650351:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b30c0 x1876028970759424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121269.650361:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.650364:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789121269.650366:0:37:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121269.650369:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 704 00000100:00080000:1.0:1789121269.650371:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789121269.650374:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121269.650385:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99b1e00 x1876028970759552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121269.650407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.650411:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121269.650414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.650417:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789121269.650447:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970759808:0@lo:400:kworker.0 00000100:00100000:1.0:1789121269.650515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121269.650549:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789121269.650556:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970759168:0@lo:400:kworker.0 00000100:00100000:1.0:1789121269.650585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121269.650613:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970759936:0@lo:400:kworker.0 00000100:00100000:1.0:1789121269.650647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121269.650677:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970759168 00000100:00100000:1.0:1789121269.650685:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970759168 00000100:00100000:1.0:1789121269.650730:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789121269.650740:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3646:x1876028970759168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121269.650788:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:3646:x1876028970759168:12345-0@lo:400:kworker.0 Request processed in 49us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121269.650795:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789121269.650860:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970759168:0@lo:400:kworker.0 00000100:00100000:3.0:1789121269.652893:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789121269.652973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121269.653009:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121269.653016:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970759296:0@lo:400:kworker.0 00000100:00100000:3.0:1789121269.653042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121269.653426:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121269.653433:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970750464:0@lo:8:kworker.0 00000100:00100000:2.0:1789121269.653474:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970759808 00000100:00100000:2.0:1789121269.653481:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970759808 00000100:00100000:2.0:1789121269.653530:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970759296 00000100:00100000:2.0:1789121269.653533:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970759296 00000100:00100000:2.0:1789121269.653550:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121269.653563:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.653628:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970759808:12345-0@lo:400:kworker.0 Request processed in 66us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121269.653636:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121269.653655:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121269.653661:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970759296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.653707:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970759296:12345-0@lo:400:kworker.0 Request processed in 45us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121269.653713:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121269.653737:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970759936 00000100:00100000:2.0:1789121269.653741:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970759936 00000100:00100000:2.0:1789121269.653761:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970759680 00000100:00100000:2.0:1789121269.653764:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970759680 00000100:00100000:2.0:1789121269.653776:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121269.653781:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970759936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.653814:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970759936:12345-0@lo:400:kworker.0 Request processed in 32us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121269.653843:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121269.653856:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121269.653871:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970759680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.653900:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970759680:12345-0@lo:400:kworker.0 Request processed in 31us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121269.653907:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789121269.653964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99b1680 x1876028970759936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121269.653979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970759936:0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.653993:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789121269.654017:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970759424:0@lo:8:kworker.0 00000400:00000100:2.0:1789121269.654041:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970759424 offset 0 length 520: 4 00000100:00100000:2.0:1789121269.654081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970759552:0@lo:8:kworker.0 00000400:00000100:2.0:1789121269.654099:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970759552 offset 0 length 520: 4 00000100:00100000:0.0:1789121269.657491:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970759296:0@lo:400:kworker.0 00010000:00080000:0.0:1789121269.657514:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99b0b40 x1876028970759680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121269.657526:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970759680:0@lo:400:kworker.0 00000100:00080000:1.0:1789121269.659568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.659577:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121269.659580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121269.659584:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:0.0:1789121269.668857:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789121270.354102:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789121270.612669:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789121271.378705:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121272.404037:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121273.428106:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789121273.556318:0:24935:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789121273.556324:0:24935:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789121273.556325:0:24935:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789121273.556469:0:24935:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946782aec000 00000020:01000004:3.0:1789121273.556491:0:24935:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789121273.556508:0:24935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789121273.556527:0:24935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff946783c7b490) 00000020:00000080:3.0:1789121273.556546:0:24935:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789121273.658287:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789121273.668161:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789121273.668529:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789121273.669145:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789121273.669550:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789121273.669915:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789121273.670380:0:24935:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1789121273.675029:0:24935:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789121273.675294:0:24935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789121273.675310:0:24935:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789121273.675322:0:24935:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a8310fa4 00000020:01000004:2.0:1789121273.675330:0:24935:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789121273.675352:0:24935:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789121273.675355:0:24935:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789121273.675377:0:24935:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789121273.675383:0:24935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789121273.675415:0:24935:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9468bac0b490) 00000020:00000080:2.0:1789121273.675428:0:24935:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789121273.687546:0:24935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789121273.689204:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789121273.689216:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789121273.691918:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789121273.691956:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789121273.693685:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789121273.693695:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789121273.695228:0:24935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121273.695432:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789121273.695438:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789121273.703225:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789121273.703248:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789121273.745675:0:24935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121273.746464:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789121273.746470:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789121273.747011:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970760064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121273.747103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.747241:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760064 00000100:00100000:2.0:1789121273.747250:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760064 00000100:00100000:2.0:1789121273.747315:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121273.747325:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970760064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121273.747363:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121273.747415:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970760064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.747421:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789121273.747512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970760064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121273.747697:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970760192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121273.747736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.747907:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760192 00000100:00100000:3.0:1789121273.747913:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760192 00000100:00100000:3.0:1789121273.747952:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121273.747960:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970760192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121273.747982:0:23434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789121273.748021:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970760192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.748028:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789121273.748086:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970760192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121273.756742:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789121273.756764:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789121273.758215:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789121273.758228:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789121273.761012:0:24935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121273.761223:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789121273.761230:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789121273.762004:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789121273.762011:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789121273.793602:0:24935:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789121273.793997:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789121273.794004:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789121273.794980:0:24935:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789121273.794989:0:24935:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789121273.795454:0:24935:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789121273.795486:0:24935:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789121273.795495:0:24935:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789121273.804381:0:24935:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789121273.804422:0:24935:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789121273.804427:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789121273.804429:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121273.804430:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121273.804432:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121273.804433:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121273.804440:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121273.804442:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121273.804444:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121273.804446:0:24935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121273.804449:0:24935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789121273.804451:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121273.804453:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121273.804453:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121273.804454:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121273.804455:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121273.804457:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121273.804457:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121273.804458:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121273.804459:0:24935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121273.804488:0:24935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789121273.804509:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121273.804591:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.804686:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121273.804735:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760320 00000100:00100000:3.0:1789121273.804743:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760320 00000100:00100000:3.0:1789121273.805006:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789121273.805019:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24935:x1876028970760320:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789121273.805051:0:23424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789121273.805055:0:23424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789121273.805058:0:23424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789121273.805450:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24935:x1876028970760320:12345-0@lo:253:mount.lustre.0 Request processed in 434us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.805460:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789121273.805556:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121273.805569:0:24935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789121273.805573:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121273.805574:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121273.805575:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121273.805576:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121273.805577:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121273.805578:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121273.805579:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121273.805581:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121273.805583:0:24935:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789121273.805605:0:24935:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946782aec000 from lustre-OST0000 10000000:01000000:2.0:1789121273.805637:0:24935:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789121273.805641:0:24935:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789121273.805650:0:24935:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946882bf0000 local copy 00010000:00010000:2.0:1789121273.805661:0:24935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121273.805777:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121273.805811:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.805868:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.805923:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760448 00000100:00100000:1.0:1789121273.805929:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760448 00000100:00100000:1.0:1789121273.805976:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789121273.805991:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24935:x1876028970760448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121273.806074:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24935:x1876028970760448:12345-0@lo:501:mount.lustre.0 Request processed in 84us (262us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789121273.806082:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789121273.806170:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789121273.806184:0:24935:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789121273.806203:0:24935:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789121273.806209:0:24935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.806218:0:24935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121273.806242:0:24935:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946782aec000 10000000:01000000:0.0:1789121273.806247:0:24935:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789121273.806251:0:24935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789121273.806254:0:24935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789121273.806259:0:24935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789121273.806262:0:24935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789121273.806298:0:24935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.806306:0:24935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.806316:0:24935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121273.806338:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121273.806371:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.806396:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.806522:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760576 00000100:00100000:1.0:1789121273.806526:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760576 00000100:00100000:1.0:1789121273.806544:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789121273.806551:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+18:24935:x1876028970760576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121273.806561:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121273.806572:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2800/0xb74d2367a8310fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310fb2 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.806592:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2800/0xb74d2367a8310fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310fb2 expref: 19 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.806603:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2800/0xb74d2367a8310fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310fb2 expref: 19 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.806613:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2800, rc 0) 00000100:00100000:1.0:1789121273.806650:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760576:12345-0@lo:101:mount.lustre.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.806656:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789121273.806730:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121273.806743:0:24935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fb9 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.806752:0:24935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310fb9 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121273.807776:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1789121273.808396:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121273.808606:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789121273.808633:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789121273.808648:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789121273.808664:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789121273.808679:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789121273.808692:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789121273.808706:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789121273.808718:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789121273.808731:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1789121273.808745:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1789121273.808760:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1789121273.808772:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1789121273.808789:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1789121273.808794:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1789121273.808888:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121273.808951:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.809012:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e1386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.809106:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760704 00000100:00100000:2.0:1789121273.809114:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760704 00000100:00100000:2.0:1789121273.809160:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789121273.809170:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121273.809316:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760704:12345-0@lo:501:mount.lustre.0 Request processed in 146us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.809325:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789121273.809633:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121273.809666:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121273.809706:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.809765:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e1386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.809797:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760832 00000100:00100000:2.0:1789121273.809802:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760832 00000100:00100000:2.0:1789121273.809942:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789121273.809950:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121273.810573:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760832:12345-0@lo:503:mount.lustre.0 Request processed in 622us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.810582:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789121273.810659:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760832:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789121273.811056:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121273.811135:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121273.811181:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.811483:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689103ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.811562:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970760960 00000100:00100000:1.0:1789121273.811569:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970760960 00000100:00100000:1.0:1789121273.811601:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789121273.811609:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121273.812026:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970760960:12345-0@lo:502:mount.lustre.0 Request processed in 417us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.812044:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789121273.812138:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970760960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121273.812315:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789121273.812343:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789121273.812358:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789121273.812372:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789121273.812385:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789121273.812398:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789121273.812410:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789121273.812422:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789121273.812435:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1789121273.812447:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1789121273.812461:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1789121273.812473:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1789121273.812502:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121273.812542:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.812573:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689103ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.812678:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761088 00000100:00100000:1.0:1789121273.812683:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761088 00000100:00100000:1.0:1789121273.812708:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789121273.812715:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970761088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121273.812796:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970761088:12345-0@lo:502:mount.lustre.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.812803:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789121273.812917:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121273.812957:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1789121273.812965:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789121273.813815:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789121273.813851:0:24952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789121273.813859:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.813861:0:24952:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789121273.813867:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789121273.813882:0:24952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff946884158000) 00000020:00000080:0.0:1789121273.813904:0:24952:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789121273.813911:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789121273.813994:0:24952:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aec000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789121273.814003:0:24952:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789121273.814011:0:24952:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a8310fc7 00010000:00010000:0.0:1789121273.818197:0:24952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789121273.818915:0:24952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1789121273.826107:0:24952:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:0.0:1789121273.834877:0:24952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789121273.834892:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121273.834901:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834903:0:24952:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789121273.834907:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789121273.834910:0:24952:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789121273.834912:0:24952:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121273.834913:0:24952:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121273.834915:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789121273.834918:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834919:0:24952:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789121273.834921:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121273.834925:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834926:0:24952:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789121273.834929:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789121273.834931:0:24952:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789121273.834941:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121273.834944:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834945:0:24952:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789121273.834948:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121273.834950:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834951:0:24952:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789121273.834954:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789121273.834981:0:24952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121273.834984:0:24952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121273.834985:0:24952:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789121273.834989:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1789121273.835184:0:24935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789121273.835216:0:24935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789121273.835243:0:24935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fb9 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121273.835256:0:24935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac000/0xb74d2367a8310fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fb9 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121273.835265:0:24935:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aec000 from 1 10000000:01000000:2.0:1789121273.835274:0:24935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121273.835314:0:24935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121273.835323:0:24935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121273.835333:0:24935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121273.835358:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121273.835434:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.835699:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.838435:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761216 00000100:00100000:1.0:1789121273.838447:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761216 00000100:00100000:1.0:1789121273.838536:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789121273.838547:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970761216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121273.838565:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121273.838594:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310fce expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.838624:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310fce expref: 20 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.838637:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310fce expref: 20 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.838647:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789121273.838784:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761216:12345-0@lo:101:mount.lustre.0 Request processed in 239us (3349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.838792:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789121273.839106:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121273.839135:0:24935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.839146:0:24935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121273.840360:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:0.0:1789121273.840788:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121273.841708:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789121273.841753:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789121273.841771:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789121273.841786:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789121273.841800:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789121273.841814:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789121273.841873:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789121273.841888:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:0.0:1789121273.841903:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:0.0:1789121273.841917:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:0.0:1789121273.841930:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:0.0:1789121273.841966:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:0.0:1789121273.841991:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:0.0:1789121273.842007:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:0.0:1789121273.842357:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:0.0:1789121273.842381:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:0.0:1789121273.842396:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:0.0:1789121273.842421:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:0.0:1789121273.842427:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:0.0:1789121273.842802:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121273.842938:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.842994:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789121273.843311:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761344 00000100:00100000:1.0:1789121273.843345:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761344 00000100:00100000:1.0:1789121273.843413:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789121273.843425:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121273.843650:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761344:12345-0@lo:501:mount.lustre.0 Request processed in 227us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.843658:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789121273.843997:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121273.844277:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121273.844337:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121273.844379:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.844437:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761472 00000100:00100000:2.0:1789121273.844443:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761472 00000100:00100000:2.0:1789121273.844482:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789121273.844491:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121273.844595:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761472:12345-0@lo:503:mount.lustre.0 Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.844603:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789121273.844957:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121273.845388:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121273.845482:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121273.845525:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.845554:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783ea4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.846331:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761600 00000100:00100000:2.0:1789121273.846341:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761600 00000100:00100000:2.0:1789121273.846393:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789121273.846402:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121273.846541:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761600:12345-0@lo:502:mount.lustre.0 Request processed in 139us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.846549:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789121273.848977:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121273.851556:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789121273.851617:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789121273.851634:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789121273.851645:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789121273.851659:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789121273.851671:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789121273.851683:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789121273.851694:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:3.0:1789121273.851706:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:3.0:1789121273.851718:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:3.0:1789121273.851730:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:3.0:1789121273.851744:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:3.0:1789121273.851775:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:3.0:1789121273.851791:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:3.0:1789121273.851804:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:3.0:1789121273.851816:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:3.0:1789121273.851844:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:3.0:1789121273.851894:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121273.851985:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121273.852080:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761728 00000100:00100000:1.0:1789121273.852089:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761728 00000100:00100000:1.0:1789121273.852172:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789121273.852184:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121273.852305:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761728:12345-0@lo:502:mount.lustre.0 Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121273.852313:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789121273.852936:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783ea4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121273.852965:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121273.853697:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:3.0:1789121273.853715:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789121273.857784:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.857799:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857802:0:24956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789121273.857810:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946782aec000 00000020:00000080:3.0:1789121273.857813:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.857849:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.857853:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857855:0:24956:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789121273.857857:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.857860:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857861:0:24956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789121273.857864:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946782aec000 00000020:00000080:3.0:1789121273.857866:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.857927:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.857930:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857932:0:24956:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789121273.857934:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.857937:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857938:0:24956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789121273.857941:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aec000 00000020:00000080:3.0:1789121273.857943:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.857958:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.857961:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857962:0:24956:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789121273.857964:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.857967:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857968:0:24956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789121273.857971:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aec000 00000020:00000080:3.0:1789121273.857973:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.857987:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.857990:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.857992:0:24956:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789121273.857994:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.858006:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.858007:0:24956:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789121273.858011:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aec000 00000020:00000080:3.0:1789121273.858013:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.858033:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.858036:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.858037:0:24956:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789121273.858040:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121273.858042:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.858043:0:24956:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789121273.858046:0:24956:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aec000 00000020:00000080:3.0:1789121273.858048:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789121273.858070:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121273.858073:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121273.858074:0:24956:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789121273.858077:0:24956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:1.0:1789121273.858281:0:24935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789121273.858313:0:24935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789121273.858338:0:24935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.858350:0:24935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121273.858409:0:24935:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789121273.858412:0:24935:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946782aec000 10000000:01000000:1.0:1789121273.858415:0:24935:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946782aec000 10000000:01000000:1.0:1789121273.858419:0:24935:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789121273.858431:0:24935:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946782aec000 from 1 10000000:01000000:1.0:1789121273.858433:0:24935:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789121273.858473:0:24935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.858481:0:24935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121273.858492:0:24935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121273.858519:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914da940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121273.858604:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121273.858658:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121273.858849:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761856 00000100:00100000:3.0:1789121273.858857:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761856 00000100:00100000:3.0:1789121273.858905:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789121273.858915:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:24935:x1876028970761856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121273.858929:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121273.858944:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1e00/0xb74d2367a8310fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310fdc expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.858967:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1e00/0xb74d2367a8310fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310fdc expref: 21 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.858979:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1e00/0xb74d2367a8310fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310fdc expref: 21 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.858988:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1e00, rc 0) 00000100:00100000:3.0:1789121273.859038:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970761856:12345-0@lo:101:mount.lustre.0 Request processed in 124us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.859046:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789121273.859142:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914da940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121273.859159:0:24935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fe3 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.859168:0:24935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310fe3 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121273.868091:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789121273.868436:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121273.868629:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789121273.868656:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789121273.868672:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789121273.868685:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789121273.868714:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789121273.868727:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789121273.868738:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789121273.868749:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789121273.868760:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789121273.868770:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789121273.868781:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789121273.868792:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789121273.868803:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789121273.868813:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789121273.868847:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789121273.868859:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789121273.868870:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789121273.868881:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789121273.868892:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789121273.868902:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789121273.868924:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789121273.868936:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789121273.868946:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789121273.868957:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789121273.868968:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789121273.868978:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789121273.868988:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789121273.869006:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789121273.869017:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789121273.869030:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789121273.869041:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789121273.869052:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789121273.869063:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789121273.869076:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789121273.869088:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789121273.869101:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789121273.869140:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789121273.869157:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789121273.869172:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789121273.869184:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789121273.869194:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789121273.869205:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789121273.869215:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789121273.869226:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789121273.869236:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789121273.869247:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789121273.869258:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789121273.869268:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789121273.869354:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789121273.869372:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789121273.869386:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789121273.869390:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789121273.869469:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121273.869535:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.869590:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783ea40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.870853:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970761984 00000100:00100000:2.0:1789121273.870870:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970761984 00000100:00100000:2.0:1789121273.870926:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789121273.870934:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970761984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121273.872498:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970761984:12345-0@lo:501:mount.lustre.0 Request processed in 1555us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121273.872675:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970761984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121273.872735:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121273.872798:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.872845:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789121273.880624:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.881693:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762112 00000100:00100000:2.0:1789121273.881704:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762112 00000100:00100000:2.0:1789121273.881759:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789121273.881770:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121273.885363:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762112:12345-0@lo:503:mount.lustre.0 Request processed in 3582us (12551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.885381:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789121273.890244:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789121273.890778:0:24935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121273.890886:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121273.890974:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.891034:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121273.891058:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762240 00000100:00100000:0.0:1789121273.891064:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762240 00000100:00100000:0.0:1789121273.891345:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789121273.891356:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121273.891486:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762240:12345-0@lo:502:mount.lustre.0 Request processed in 131us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121273.891494:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789121273.892193:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789121273.892454:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789121273.892487:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789121273.892503:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789121273.892519:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789121273.892533:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789121273.892549:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789121273.892564:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789121273.892578:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789121273.892593:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789121273.892608:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789121273.892624:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789121273.892638:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789121273.892651:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789121273.892665:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789121273.892678:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789121273.892711:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789121273.892737:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789121273.892753:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789121273.892768:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789121273.892783:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789121273.892797:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789121273.892809:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789121273.892844:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789121273.892860:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789121273.892873:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789121273.892888:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789121273.892901:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789121273.892914:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789121273.892928:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789121273.892941:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789121273.892952:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789121273.892981:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789121273.892997:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789121273.893010:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789121273.893043:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789121273.893056:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789121273.893069:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789121273.893083:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789121273.893095:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789121273.893107:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789121273.893129:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789121273.893147:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789121273.893159:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789121273.893169:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789121273.893180:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789121273.893191:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789121273.893202:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789121273.893229:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789121273.893290:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121273.893375:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121273.897944:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.898308:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762368 00000100:00100000:2.0:1789121273.898320:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762368 00000100:00100000:2.0:1789121273.898393:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789121273.898403:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121273.901752:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762368:12345-0@lo:502:mount.lustre.0 Request processed in 3337us (8364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.901769:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789121273.901795:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121273.902184:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789121273.902215:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789121273.902255:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121273.902306:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.902352:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121273.903164:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762496 00000100:00100000:2.0:1789121273.903173:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762496 00000100:00100000:2.0:1789121273.903222:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789121273.903230:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121273.903350:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970762496:12345-0@lo:502:mount.lustre.0 Request processed in 119us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.903366:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789121273.905871:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970762496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789121273.905988:0:24935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789121273.906009:0:24935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789121273.912052:0:24963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789121273.912071:0:24963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff946783c79a48) 00000020:00000080:3.0:1789121273.912096:0:24963:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789121273.912237:0:24963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789121273.912248:0:24963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946782aec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789121273.912250:0:24963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aec000 3 00010000:00080000:3.0:1789121273.912293:0:24963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946782a1b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121273.917392:0:24963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789121273.917629:0:24963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789121273.917679:0:24963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789121273.917692:0:24963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb74d2367a8310ff1 00000100:00080000:3.0:1789121273.917704:0:24963:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121273.917709:0:24963:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff946782a1b800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121273.917748:0:24963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946891480000 x1876028970762624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121273.917801:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970762624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121273.917924:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789121273.917995:0:24963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121273.918043:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.918047:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.918050:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.918053:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.918088:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.918092:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.918094:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.918097:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121273.918242:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762624 00000100:00100000:2.0:1789121273.918251:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762624 00000100:00100000:2.0:1789121273.918282:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121273.918290:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970762624:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789121273.918315:0:23429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 724 last 0 00000020:00000080:2.0:1789121273.918346:0:23429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb74d2367a8310ff8 00000004:00100000:2.0:1789121273.918361:0:23429:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789121273.918399:0:23429:0:(import.c:65:import_set_state_nolock()) ffff9468bae39000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121273.918455:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876028970762624:12345-0@lo:38:llog_process_th.0 Request processed in 164us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.918463:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121273.918488:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970762752:0@lo:400:kworker.0 00000100:00100000:2.0:1789121273.919325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.919380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970763008:0@lo:400:kworker.0 00000100:00100000:2.0:1789121273.919412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.919434:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121273.919440:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970763136:0@lo:400:kworker.0 00000100:00100000:2.0:1789121273.919462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121273.919491:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763136 00000100:00100000:2.0:1789121273.919496:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763136 00000100:00100000:3.0:1789121273.921157:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970762880:0@lo:400:kworker.0 00000100:00100000:3.0:1789121273.921225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.921743:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762880 00000100:00100000:3.0:1789121273.921752:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762880 00000100:00100000:3.0:1789121273.921801:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121273.921810:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970762880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121273.921816:0:23431:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789121273.921838:0:23431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789121273.921866:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970762752 00000100:00100000:2.0:1789121273.921870:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970762752 00000100:00100000:3.0:1789121273.922509:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970762880:12345-0@lo:400:kworker.0 Request processed in 697us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.922520:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121273.922545:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789121273.922555:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970763136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121273.922610:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970763136:12345-0@lo:400:kworker.0 Request processed in 57us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.922616:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789121273.922665:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf7492c0 x1876028970763136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121273.922682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970763136:0@lo:400:kworker.0 00010000:00080000:3.0:1789121273.922714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946891483c00 x1876028970762880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121273.922722:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970762880:0@lo:400:kworker.0 00000100:00100000:0.0:1789121273.923955:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763008 00000100:00100000:0.0:1789121273.923967:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763008 00000100:00100000:2.0:1789121273.923970:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121273.923980:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970762752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121273.923993:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789121273.923998:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970763008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121273.924367:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970763008:12345-0@lo:400:kworker.0 Request processed in 366us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121273.924376:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121273.924391:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970762752:12345-0@lo:400:kworker.0 Request processed in 413us (5070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121273.924397:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121273.924442:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970762752:0@lo:400:kworker.0 00010000:00080000:2.0:1789121273.924485:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946891480000 x1876028970762624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121273.924495:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121273.924504:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789121273.924523:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789121273.924528:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789121273.924531:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782a1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789121273.924538:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970762624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121273.926034:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970763008:0@lo:400:kworker.0 00000020:01000004:3.0:1789121273.926192:0:24963:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789121273.926209:0:24963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff946783c78000) 00000020:00000080:3.0:1789121273.926231:0:24963:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789121273.926333:0:24963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789121273.926337:0:24963:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946782aec000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789121273.926339:0:24963:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aec000 3 00010000:00080000:3.0:1789121273.926370:0:24963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946782a1c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121273.935777:0:24963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789121273.937808:0:24963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789121273.937887:0:24963:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789121273.937917:0:24963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb74d2367a8311006 00000100:00080000:3.0:1789121273.937930:0:24963:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121273.937937:0:24963:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff946782a1c800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121273.937976:0:24963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf74a940 x1876028970763264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121273.938006:0:24963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789121273.938038:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.938043:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.938045:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.938048:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.938052:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789121273.938192:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970763264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789121273.938272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789121273.938368:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121273.938372:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121273.938376:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789121273.938399:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763264 00000100:00100000:3.0:1789121273.938407:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763264 00000100:00100000:3.0:1789121273.938445:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121273.938453:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970763264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789121273.938483:0:23429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 724 last 0 00000020:00000080:3.0:1789121273.939261:0:23429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb74d2367a831100d 00000004:00100000:3.0:1789121273.939285:0:23429:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789121273.939321:0:23429:0:(import.c:65:import_set_state_nolock()) ffff9467849f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121273.940184:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876028970763264:12345-0@lo:38:llog_process_th.0 Request processed in 1726us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.940196:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1789121273.941054:0:24963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789121273.944880:0:24935:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789121273.944936:0:24935:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789121273.944962:0:24935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fe3 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.944975:0:24935:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a8310fdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310fe3 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789121273.945047:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789121273.945050:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121273.945051:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121273.945053:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121273.945054:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121273.945056:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121273.945194:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121273.945197:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121273.945198:0:24935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789121273.945203:0:24935:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789121273.945206:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789121273.945208:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121273.945209:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121273.945210:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121273.945212:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121273.945213:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121273.945214:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121273.945215:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121273.945216:0:24935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789121273.945247:0:24935:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789121273.945270:0:24935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970763392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789121273.945347:0:24935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121273.945438:0:24935:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5a80 going to sleep for 11 seconds 00010000:00080000:1.0:1789121273.946774:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf74a940 x1876028970763264/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121273.946791:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789121273.946801:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789121273.946810:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789121273.946816:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789121273.946847:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782a1c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789121273.946856:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970763264:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121273.948639:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763392 00000100:00100000:3.0:1789121273.948652:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763392 00000100:00100000:3.0:1789121273.948812:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789121273.948852:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:24935:x1876028970763392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789121273.948891:0:23421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789121273.948906:0:23421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789121273.960380:0:23421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789121273.960400:0:23421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789121273.960488:0:23445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789121273.960494:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789121273.960591:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960613:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960621:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960628:0:23445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960679:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960717:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 21 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121273.960734:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970763520:0@lo:104: 00000100:00100000:3.0:1789121273.960813:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789121273.960889:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.960897:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 21 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121273.960904:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970763648:0@lo:104: 00000100:00100000:3.0:1789121273.960927:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.960944:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468999d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121273.960971:0:23413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789121273.960991:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763520 00000100:00100000:3.0:1789121273.960999:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763520 00000100:00100000:3.0:1789121273.961137:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763648 00000100:00100000:3.0:1789121273.961140:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763648 00000100:00100000:3.0:1789121273.961158:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121273.961167:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970763520:12345-0@lo:104: 00010000:00010000:3.0:1789121273.961181:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961235:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121273.961241:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970763520:12345-0@lo:104: Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.961247:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121273.961364:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121273.961372:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94678336dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970763648:12345-0@lo:104: 00010000:00010000:3.0:1789121273.961381:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961417:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789121273.961422:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94678336dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970763648:12345-0@lo:104: Request processed in 52us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.961429:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789121273.961480:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121273.961486:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961494:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121273.961497:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961587:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121273.961597:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121273.961603:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789121273.961636:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961643:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121273.961664:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961680:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2c00/0xb74d2367a8310f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f6c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961690:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121273.961694:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961700:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121273.961703:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961710:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121273.961717:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121273.961722:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789121273.961734:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961739:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121273.961745:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961751:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac400/0xb74d2367a8310f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f5e expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.961762:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121273.961769:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121273.961770:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121273.961778:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121273.961798:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970763776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121273.961852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.961882:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121273.961887:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970763904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121273.961908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121273.961937:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763776 00000100:00100000:3.0:1789121273.961940:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763776 00010000:00010000:3.0:1789121273.961956:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 22 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121273.961975:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970763904 00000100:00100000:3.0:1789121273.961977:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970763904 00010000:00010000:3.0:1789121273.961986:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 23 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121273.961998:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121273.962003:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:3646:x1876028970763776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121273.962027:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121273.962033:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 23 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962045:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 23 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962062:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121273.962089:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:3646:x1876028970763776:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.962104:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121273.962118:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121273.962137:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468abbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:3646:x1876028970763904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121273.962144:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121273.962149:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 22 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962157:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 22 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962169:0:23415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962177:0:23415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789121273.962191:0:23415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006394053s 00010000:00010000:3.0:1789121273.962196:0:23415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962204:0:23415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962210:0:23415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962217:0:23415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962222:0:23415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121273.962235:0:23415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962243:0:23415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962252:0:23415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121273.962262:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789121273.962919:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1a00/0xb74d2367a8310f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f65 expref: 22 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121273.962935:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970763520:0@lo:104: 00010000:00010000:0.0:1789121273.962947:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0e00/0xb74d2367a8310f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f57 expref: 21 pid: 23424 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121273.962954:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970763648:0@lo:104: 00010000:00010000:0.0:1789121273.962977:0:23445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.962997:0:23445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.963003:0:23445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121273.963010:0:23445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0c00/0xb74d2367a8311014 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121273.963108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970763776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121273.963166:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468abbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:3646:x1876028970763904:12345-0@lo:103:ldlm_bl.0 Request processed in 1030us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121273.963174:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121273.963227:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970763904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121273.964432:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:24935:x1876028970763392:12345-0@lo:253:mount.lustre.0 Request processed in 15607us (19081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121273.964443:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789121273.964497:0:24935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:24935:1876028970763392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789121273.964522:0:24935:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789121273.964525:0:24935:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789121273.964527:0:24935:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121273.964528:0:24935:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121273.964529:0:24935:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121273.964529:0:24935:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121273.964531:0:24935:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121273.964532:0:24935:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121273.964534:0:24935:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121273.964536:0:24935:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789121273.964548:0:24935:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1789121273.971095:0:24935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789121273.981551:0:24935:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789121273.981567:0:24935:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789121273.981613:0:24935:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789121273.981672:0:24935:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789121273.981700:0:24935:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789121273.981738:0:24935:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789121273.983663:0:24935:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121273.985246:0:24935:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121274.452092:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789121275.033963:0:25018:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121275.034214:0:25018:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121275.474049:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789121275.604533:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789121275.604542:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946891f07000 from 13 10000000:01000000:0.0:1789121275.604548:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789121275.604601:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.604613:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.604624:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121275.604655:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121275.604726:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121275.604779:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121275.604881:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764032 00000100:00100000:2.0:1789121275.604889:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764032 00000100:00100000:2.0:1789121275.604987:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789121275.604998:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+19:23426:x1876028970764032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121275.605758:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121275.605780:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831101b expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121275.605810:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831101b expref: 20 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121275.605854:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831101b expref: 20 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121275.605889:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e75800, rc 0) 00000100:00100000:2.0:1789121275.605955:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:23426:x1876028970764032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 959us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121275.605963:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789121275.606189:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121275.606220:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606230:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121275.606301:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789121275.606342:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121275.606374:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121275.606392:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764160 00000100:00100000:0.0:1789121275.606404:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764160 00000100:00100000:0.0:1789121275.606440:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789121275.606448:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:23426:x1876028970764160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121275.606463:0:23421:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121275.606480:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121275.606483:0:23421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789121275.606555:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:23426:x1876028970764160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121275.606563:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789121275.606596:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789121275.606653:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789121275.606661:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606670:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121275.606680:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789121275.606682:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468c076d800 from 13 10000000:01000000:0.0:1789121275.606684:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789121275.606702:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606709:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606718:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121275.606730:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121275.606758:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121275.606775:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121275.606787:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764288 00000100:00100000:0.0:1789121275.606791:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764288 00000100:00100000:0.0:1789121275.606812:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789121275.606817:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:23426:x1876028970764288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121275.606851:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121275.606861:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311029 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606876:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311029 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606885:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311029 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606892:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9acc00, rc 0) 00000100:00100000:0.0:1789121275.606921:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970764288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121275.606927:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789121275.606957:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121275.606967:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.606974:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121275.607027:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789121275.607059:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121275.607072:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bb9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121275.607084:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764416 00000100:00100000:0.0:1789121275.607088:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764416 00000100:00100000:0.0:1789121275.607124:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789121275.607131:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970764416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121275.607141:0:23423:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121275.607152:0:23423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121275.607155:0:23423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789121275.607215:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970764416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121275.607222:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789121275.607250:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970764416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789121275.607284:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789121275.607289:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121275.607296:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121276.502514:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121277.011465:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121277.525350:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121278.546102:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121278.866180:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970764544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121278.866275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121278.866363:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764544 00000100:00100000:2.0:1789121278.866373:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764544 00000100:00100000:2.0:1789121278.866429:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121278.866440:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970764544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121278.866488:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121278.866537:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970764544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121278.866544:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121278.866601:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970764544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121278.867198:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970764672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121278.867236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121278.867341:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764672 00000100:00100000:3.0:1789121278.867347:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764672 00000100:00100000:3.0:1789121278.867387:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789121278.867395:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970764672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121278.867422:0:23434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789121278.867462:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970764672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121278.867468:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121278.867543:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970764672:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789121279.378201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121279.378221:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121279.378224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121279.378227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121279.378242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121279.378245:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121279.378248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121279.378251:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789121279.378317:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970764800:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.378418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121279.378464:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970765312:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.378497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121279.378526:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121279.378532:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970764928:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.378554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121279.378581:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970765056:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.378604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121279.378622:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121279.378627:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970765184:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.378646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121279.378872:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764800 00000100:00100000:3.0:1789121279.378882:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764800 00000100:00100000:3.0:1789121279.378932:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789121279.378942:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3646:x1876028970764800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.379006:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3646:x1876028970764800:12345-0@lo:400:kworker.0 Request processed in 65us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121279.379014:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789121279.379049:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765312 00000100:00100000:3.0:1789121279.379052:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765312 00000100:00100000:3.0:1789121279.379100:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970764928 00000100:00100000:3.0:1789121279.379104:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970764928 00000100:00100000:3.0:1789121279.379114:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765056 00000100:00100000:3.0:1789121279.379115:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765056 00000100:00100000:3.0:1789121279.379123:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765184 00000100:00100000:3.0:1789121279.379125:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765184 00000100:00100000:3.0:1789121279.379140:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121279.379145:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970765312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.379177:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970765312:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121279.379183:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121279.379194:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121279.379199:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970764928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.379222:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970764928:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121279.379227:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121279.379236:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121279.379242:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.379271:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970765056:12345-0@lo:400:kworker.0 Request processed in 28us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121279.379277:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121279.379288:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121279.379302:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970765184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.379330:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970765184:12345-0@lo:400:kworker.0 Request processed in 30us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121279.379336:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789121279.379937:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121279.379943:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789121279.381276:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf7483c0 x1876028970765184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121279.381293:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970765184:0@lo:400:kworker.0 00010000:00080000:3.0:1789121279.381306:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74b0c0 x1876028970765056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121279.381315:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970765056:0@lo:400:kworker.0 00010000:00080000:3.0:1789121279.382289:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74ad00 x1876028970764928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121279.382305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970764928:0@lo:400:kworker.0 00000100:00100000:3.0:1789121279.382321:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970764800:0@lo:400:kworker.0 00010000:00080000:3.0:1789121279.382331:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74bc00 x1876028970765312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121279.382338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970765312:0@lo:400:kworker.0 00010000:00010000:2.0:1789121279.570160:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121280.595217:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789121280.750174:0:25308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1789121280.850680:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121281.618407:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789121281.793619:0:25360:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789121281.793799:0:25360:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789121282.642106:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789121282.739542:0:25410:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121282.739912:0:25410:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789121283.156018:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121268/real 1789121268] req@ffff946783ebde00 x1876028970758912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.156061:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783ebde00 x1876028970758912/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.156071:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121268/real 1789121268] req@ffff946783ebd2c0 x1876028970759040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.156082:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783ebd2c0 x1876028970759040/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789121283.156115:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468b98a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121283.156140:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121283.156145:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970758912:0@lo:8:kworker.0 00000100:00080000:1.0:1789121283.156151:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121283.156156:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121283.156159:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970759040:0@lo:8:kworker.0 00000100:00100000:2.0:1789121283.156724:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970765440:0@lo:400:kworker.0 00000100:00100000:2.0:1789121283.156800:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121283.156887:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765440 00000100:00100000:2.0:1789121283.156897:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765440 00000100:00100000:2.0:1789121283.156947:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789121283.156956:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3647:x1876028970765440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121283.157009:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3647:x1876028970765440:12345-0@lo:400:kworker.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121283.157016:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789121283.157070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970765440:0@lo:400:kworker.0 00000100:00080000:2.0:1789121283.157103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121283.157107:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121283.157110:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121283.157113:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121283.157121:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970765568:0@lo:400:kworker.0 00000100:00100000:2.0:1789121283.157149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121283.157479:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765568 00000100:00100000:2.0:1789121283.157484:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765568 00000100:00100000:2.0:1789121283.157550:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789121283.157558:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121283.157600:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970765568:12345-0@lo:400:kworker.0 Request processed in 43us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121283.157606:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789121283.157745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121283.157749:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789121283.157764:0:37:0:(import.c:65:import_set_state_nolock()) ffff9468b98a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121283.157769:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:3.0:1789121283.157773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789121283.157778:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468b98a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121283.157787:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970765824:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.157814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121283.165858:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf74b0c0 x1876028970765952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121283.165883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121283.165888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121283.165892:0:37:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121283.165897:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:3.0:1789121283.165902:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789121283.165909:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121283.165921:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf7483c0 x1876028970766080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121283.165949:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121283.165960:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970766208:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121283.166112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970765696:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121283.166153:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970766464:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121283.166202:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121283.166208:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970766336:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121283.166292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970765568:0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166335:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766208 00000100:00100000:3.0:1789121283.166341:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766208 00000100:00100000:3.0:1789121283.166377:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765696 00000100:00100000:3.0:1789121283.166380:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765696 00000100:00100000:3.0:1789121283.166391:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766464 00000100:00100000:3.0:1789121283.166406:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766464 00000100:00100000:3.0:1789121283.166433:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766336 00000100:00100000:3.0:1789121283.166435:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766336 00000100:00100000:3.0:1789121283.166451:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789121283.166459:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970766208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166508:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970766208:12345-0@lo:400:kworker.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121283.166516:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789121283.166533:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789121283.166538:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970765696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166580:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970765696:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121283.166586:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789121283.166598:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789121283.166603:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970766464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166627:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970766464:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121283.166633:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789121283.166643:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789121283.166649:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970766336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121283.166683:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970766336:12345-0@lo:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121283.166689:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789121283.166718:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf749680 x1876028970766208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121283.166728:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970766208:0@lo:400:kworker.0 00010000:00080000:3.0:1789121283.166751:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf748f00 x1876028970766336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121283.166759:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970766336:0@lo:400:kworker.0 00010000:00080000:3.0:1789121283.166769:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74bc00 x1876028970765696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121283.166777:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970765696:0@lo:400:kworker.0 00010000:00080000:3.0:1789121283.166785:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf748780 x1876028970766464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121283.166792:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970766464:0@lo:400:kworker.0 00000100:00100000:1.0:1789121283.170802:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765824 00000100:00100000:1.0:1789121283.170816:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765824 00000100:00100000:1.0:1789121283.170885:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121283.170895:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970765824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121283.171008:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970765824:12345-0@lo:400:kworker.0 Request processed in 114us (13192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121283.171017:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121283.171100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970765824:0@lo:400:kworker.0 00000100:00100000:1.0:1789121283.171133:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970765952:0@lo:8:kworker.0 00000100:00100000:1.0:1789121283.171169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.171202:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970766080:0@lo:8:kworker.0 00000100:00100000:1.0:1789121283.171223:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.171261:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970765952 00000100:00100000:1.0:1789121283.171265:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970765952 00000100:00100000:1.0:1789121283.171291:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766080 00000100:00100000:1.0:1789121283.171294:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766080 00000100:00100000:1.0:1789121283.171305:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121283.171309:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970765952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789121283.171346:0:24940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 733 last 0 00000020:00000080:1.0:1789121283.171374:0:24940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8311037 00002000:00100000:1.0:1789121283.171390:0:24940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9468b2745800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789121283.173214:0:24940:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789121283.173218:0:24940:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789121283.174079:0:24940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789121283.174115:0:24940:0:(import.c:65:import_set_state_nolock()) ffff9468b2746000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121283.174213:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970765952:12345-0@lo:8:kworker.0 Request processed in 2899us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121283.174224:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121283.174257:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121283.174264:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970766080:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789121283.174283:0:24940:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789121283.178633:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121283.178662:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789121283.179706:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74b0c0 x1876028970765952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121283.179721:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789121283.179731:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789121283.179740:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789121283.179746:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789121283.179758:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468b98a2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789121283.179836:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789121283.179843:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970765952:0@lo:8:kworker.0 00000004:00080000:3.0:1789121283.180575:0:24173:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789121283.180673:0:24173:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 733369852077ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789121283.180680:0:24173:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789121283.184265:0:24164:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789121283.186307:0:24174:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789121283.186341:0:24174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766720:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789121283.186514:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970766592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121283.195907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.199418:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766592 00000100:00100000:1.0:1789121283.199435:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766592 00000100:00100000:1.0:1789121283.199502:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121283.199513:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970766592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789121283.199544:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1789121283.199626:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970766592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121283.199634:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789121283.199654:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789121283.199688:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783ebe580 x1876028970766592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.199707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970766592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121283.199776:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970766080:12345-0@lo:8:kworker.0 Request processed in 25511us (28551us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789121283.199784:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789121283.199808:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121283.199813:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121283.199816:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970766080:0@lo:8:kworker.0 00000100:00100000:2.0:1789121283.200077:0:24174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121283.200115:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766720 00000100:00100000:2.0:1789121283.200119:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766720 00000100:00100000:2.0:1789121283.200144:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121283.200151:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24174:x1876028970766720:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789121283.200382:0:24174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e60c0 going to sleep for 11 seconds 00002000:00080000:2.0:1789121283.213508:0:24942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789121283.213519:0:24942:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789121283.213626:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24174:x1876028970766720:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13470us (13544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121283.213637:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789121283.213695:0:24174:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783ebc000 x1876028970766720/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789121299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121283.213708:0:24174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766720:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789121283.213722:0:24174:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789121283.213762:0:24174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766848:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789121283.213793:0:24174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121283.213812:0:24174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121283.214282:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766848 00000100:00100000:1.0:1789121283.214290:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766848 00000100:00100000:1.0:1789121283.214342:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121283.214351:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24174:x1876028970766848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789121283.214377:0:24940:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789121283.214418:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24174:x1876028970766848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 68us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121283.214425:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789121283.214452:0:24174:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783ebc000 x1876028970766848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789121299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.214462:0:24174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766848:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789121283.214471:0:24174:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789121283.214498:0:24174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766976:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789121283.214521:0:24174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.214538:0:24174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b33240 going to sleep for 11 seconds 00000100:00100000:1.0:1789121283.214549:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970766976 00000100:00100000:1.0:1789121283.214552:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970766976 00000100:00100000:1.0:1789121283.214569:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121283.214575:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24174:x1876028970766976:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789121283.214608:0:24942:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1789121283.243485:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789121283.243499:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789121283.243694:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:24174:x1876028970766976:12345-0@lo:5:osp-pre-0-1.0 Request processed in 29113us (29165us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789121283.243721:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789121283.243813:0:24174:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468914d9a40 x1876028970766976/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789121299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121283.243866:0:24174:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789121283.243874:0:24174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24174:1876028970766976:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789121283.243891:0:24174:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789121283.243946:0:24174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24174:1876028970767104:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789121283.243986:0:24174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.244013:0:24174:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b33240 going to sleep for 11 seconds 00000100:00100000:0.0:1789121283.244170:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767104 00000100:00100000:0.0:1789121283.244177:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767104 00000100:00100000:0.0:1789121283.244232:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121283.244243:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24174:x1876028970767104:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789121283.244296:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24174:x1876028970767104:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121283.244303:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789121283.244333:0:24174:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468914d9a40 x1876028970767104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121283.244344:0:24174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24174:1876028970767104:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789121283.671010:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121283.987061:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121283.987098:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970767232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121283.987394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121283.987487:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767232 00000100:00100000:1.0:1789121283.987496:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767232 00000100:00100000:1.0:1789121283.987565:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121283.987575:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970767232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121283.987617:0:23434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789121283.987676:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970767232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121283.987683:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121283.987732:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970767232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121283.988992:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970767360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121283.989072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121283.989583:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767360 00000100:00100000:2.0:1789121283.989592:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767360 00000100:00100000:2.0:1789121283.989654:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789121283.989675:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970767360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121283.989715:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121283.989768:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970767360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121283.989775:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789121283.989959:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970767360:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789121284.693708:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121285.730246:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121286.737949:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789121287.253093:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789121287.762116:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121288.598973:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121288.598991:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121288.598994:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121288.598997:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121288.599019:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121288.599023:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121288.599028:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121288.599036:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 733 00000100:00080000:3.0:1789121288.599042:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789121288.599049:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121288.599072:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf74a1c0 x1876028970768128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121288.599361:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970768128:0@lo:8:kworker.0 00000100:00100000:2.0:1789121288.600008:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121288.600257:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768128 00000100:00100000:0.0:1789121288.600267:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768128 00000100:00100000:0.0:1789121288.600310:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121288.600317:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970768128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789121288.600342:0:24940:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789121288.600498:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970767872:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.600539:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.600566:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789121288.600573:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970767488:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.600600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.600623:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970768000:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.600644:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.600668:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.600691:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.600709:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121288.600714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970767744:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.600737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.600970:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767872 00000100:00100000:1.0:1789121288.600974:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767872 00000100:00100000:1.0:1789121288.601020:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767616 00000100:00100000:1.0:1789121288.601023:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767616 00000100:00100000:1.0:1789121288.601037:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789121288.601043:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970767872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121288.601285:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.601319:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970767872:12345-0@lo:400:kworker.0 Request processed in 275us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.601326:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789121288.601346:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789121288.601353:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121288.602030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121288.602068:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121288.602086:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970768512:0@lo:400:kworker.0 00000100:00100000:3.0:1789121288.602122:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121288.602777:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970768128:12345-0@lo:8:kworker.0 Request processed in 2457us (2769us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121288.602787:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121288.602808:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768000 00000100:00100000:0.0:1789121288.602813:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768000 00000100:00100000:0.0:1789121288.602866:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789121288.602888:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970768000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121288.602932:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970768000:12345-0@lo:400:kworker.0 Request processed in 46us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121288.602939:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121288.611481:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970767616:12345-0@lo:400:kworker.0 Request processed in 10114us (10773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.611501:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789121288.611574:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767488 00000100:00100000:1.0:1789121288.611583:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767488 00000100:00100000:1.0:1789121288.611624:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789121288.611632:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3644:x1876028970767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.611689:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3644:x1876028970767488:12345-0@lo:400:kworker.0 Request processed in 58us (11088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.611695:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789121288.611736:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970767744 00000100:00100000:1.0:1789121288.611740:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970767744 00000100:00100000:1.0:1789121288.611766:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768640 00000100:00100000:1.0:1789121288.611769:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768640 00000100:00100000:1.0:1789121288.611788:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768512 00000100:00100000:1.0:1789121288.611791:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768512 00000100:00100000:1.0:1789121288.611805:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789121288.611810:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.611866:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970767744:12345-0@lo:400:kworker.0 Request processed in 54us (11126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.611872:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789121288.611882:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789121288.611888:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970768640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.611924:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970768640:12345-0@lo:400:kworker.0 Request processed in 36us (9897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.611930:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789121288.611941:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789121288.611947:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.611973:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970768512:12345-0@lo:400:kworker.0 Request processed in 26us (9851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.612002:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789121288.612032:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970768256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121288.612068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789121288.612123:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf749680 x1876028970767744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612145:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970767744:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612162:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970767616:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612184:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121288.612190:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970768384:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121288.612252:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970767488:0@lo:400:kworker.0 00010000:00080000:1.0:1789121288.612264:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf74b0c0 x1876028970768000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612273:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970768000:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970767872:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612305:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768384 00000100:00100000:1.0:1789121288.612309:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768384 00000100:00100000:1.0:1789121288.612326:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789121288.612332:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970768384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612366:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970768384:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.612372:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789121288.612392:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789121288.612402:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789121288.612405:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789121288.612450:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946891481a40 x1876028970768512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612460:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891481a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970768512:0@lo:400:kworker.0 00010000:00080000:1.0:1789121288.612470:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946891480000 x1876028970768640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612478:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970768640:0@lo:400:kworker.0 00000100:00100000:1.0:1789121288.612502:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768256 00000100:00100000:1.0:1789121288.612505:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768256 00000100:00100000:1.0:1789121288.612529:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121288.612535:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970768256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789121288.612558:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1789121288.612590:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970768256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121288.612597:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789121288.612626:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946891480b40 x1876028970768384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612634:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970768384:0@lo:400:kworker.0 00010000:00080000:1.0:1789121288.612642:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468914d8f00 x1876028970768256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121288.612656:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970768256:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789121288.614265:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121288.614274:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789121288.614279:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970768128:0@lo:8:kworker.0 00010000:00010000:1.0:1789121288.786402:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121289.111352:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970768768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121289.111473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121289.111554:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768768 00000100:00100000:1.0:1789121289.111564:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768768 00000100:00100000:1.0:1789121289.111626:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789121289.111638:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970768768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121289.111708:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789121289.111772:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970768768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121289.111781:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789121289.111866:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970768768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121289.114107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121289.122478:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970768896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121289.122599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121289.128653:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970768896 00000100:00100000:1.0:1789121289.128675:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970768896 00000100:00100000:2.0:1789121289.129014:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789121289.129030:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970768896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121289.129094:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121289.129236:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970768896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (6628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.129245:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789121289.129474:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970768896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121289.618250:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121269/real 1789121269] req@ffff9468b99b30c0 x1876028970759424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121289.618285:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468b99b30c0 x1876028970759424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121289.618316:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121269/real 1789121269] req@ffff9468b99b1e00 x1876028970759552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121289 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121289.618329:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468b99b1e00 x1876028970759552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121289 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121289.618352:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121289.618366:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121289.618371:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970759424:0@lo:8:kworker.0 00000100:00080000:3.0:1789121289.618378:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121289.618383:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121289.618386:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970759552:0@lo:8:kworker.0 00000100:00080000:2.0:1789121289.619133:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121289.619139:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789121289.619142:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121289.619149:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1789121289.619157:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789121289.619165:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff946784ac0000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121289.619193:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b25a40 x1876028970769152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121289.619209:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121289.619223:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121289.619226:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121289.619230:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 719 00000100:00080000:2.0:1789121289.619233:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789121289.619238:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121289.619254:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b27840 x1876028970769280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121289.619305:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121289.619309:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121289.619311:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121289.619315:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 738 00000100:00080000:2.0:1789121289.619318:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789121289.619322:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121289.619333:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b24000 x1876028970769664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121289.619387:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970769408:0@lo:400:kworker.0 00000100:00100000:0.0:1789121289.619461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970769536:0@lo:400:kworker.0 00000100:00100000:2.0:1789121289.619473:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.619550:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970769024:0@lo:400:kworker.0 00000100:00100000:0.0:1789121289.619558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.619600:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121289.619605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121289.619614:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970769792:0@lo:400:kworker.0 00000100:00100000:3.0:1789121289.619643:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970769920:0@lo:400:kworker.0 00000100:00100000:0.0:1789121289.619648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.619682:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121289.619691:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769536 00000100:00100000:0.0:1789121289.619700:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769536 00000100:00100000:3.0:1789121289.619757:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970769152:0@lo:8:kworker.0 00000100:00100000:0.0:1789121289.619761:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121289.619775:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970769536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121289.619800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.619839:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970769280:0@lo:8:kworker.0 00000100:00100000:2.0:1789121289.619983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970770048:0@lo:400:kworker.0 00000100:00100000:2.0:1789121289.620015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121289.620045:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970769536:12345-0@lo:400:kworker.0 Request processed in 271us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.620053:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769408 00000100:00100000:0.0:1789121289.620055:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789121289.620060:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769408 00000100:00100000:0.0:1789121289.620075:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769152 00000100:00100000:0.0:1789121289.620081:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769152 00000100:00100000:2.0:1789121289.620092:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769792 00000100:00100000:2.0:1789121289.620096:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769792 00000100:00100000:0.0:1789121289.620100:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121289.620106:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970769152:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789121289.620114:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769920 00000100:00100000:2.0:1789121289.620117:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769920 00000100:00100000:2.0:1789121289.620128:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770048 00000100:00100000:2.0:1789121289.620136:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770048 00000100:00100000:2.0:1789121289.620154:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121289.620160:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970769408:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789121289.620200:0:24940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 739 last 0 00000100:00100000:2.0:1789121289.620201:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970769408:12345-0@lo:400:kworker.0 Request processed in 39us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.620212:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121289.620226:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121289.620232:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970769792:12345-0@lo:400:kworker.0 00000020:00000080:0.0:1789121289.620247:0:24940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a831103e 00002000:00100000:0.0:1789121289.620271:0:24940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9467838a4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1789121289.620273:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970769792:12345-0@lo:400:kworker.0 Request processed in 39us (625us total) trans 0 rc 0/0 00002000:00080000:0.0:1789121289.620275:0:24940:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:2.0:1789121289.620284:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121289.620299:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121289.620306:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970769920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121289.620346:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970769920:12345-0@lo:400:kworker.0 Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.620353:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121289.620366:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121289.620372:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970770048:12345-0@lo:400:kworker.0 00002000:00100000:0.0:1789121289.620376:0:24940:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789121289.620405:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970770048:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.620413:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121289.620436:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769024 00000100:00100000:2.0:1789121289.620441:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769024 00000100:00100000:2.0:1789121289.620480:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789121289.620489:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3644:x1876028970769024:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1789121289.620518:0:24940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789121289.620532:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3644:x1876028970769024:12345-0@lo:400:kworker.0 Request processed in 44us (931us total) trans 0 rc 0/0 00000100:00080000:0.0:1789121289.620546:0:24940:0:(import.c:65:import_set_state_nolock()) ffff9467838a6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121289.620555:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789121289.620591:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970769152:12345-0@lo:8:kworker.0 Request processed in 483us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121289.620600:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121289.620630:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970769024:0@lo:400:kworker.0 00010000:00080000:0.0:1789121289.620655:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b252c0 x1876028970769792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789121289.620656:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b25e00 x1876028970769920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121289.620685:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970769792:0@lo:400:kworker.0 00000100:00100000:2.0:1789121289.620686:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970769920:0@lo:400:kworker.0 00010000:00080000:0.0:1789121289.620707:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b26580 x1876028970769536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121289.620715:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970769536:0@lo:400:kworker.0 00010000:00080000:2.0:1789121289.620729:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b24780 x1876028970769408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121289.620739:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970769408:0@lo:400:kworker.0 00010000:00080000:2.0:1789121289.620750:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b25680 x1876028970770048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121289.620758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970770048:0@lo:400:kworker.0 00000100:00100000:3.0:1789121289.620986:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.621024:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970769664:0@lo:8:kworker.0 00000100:00100000:3.0:1789121289.621058:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121289.621094:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769280 00000100:00100000:0.0:1789121289.621099:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769280 00010000:00080000:3.0:1789121289.621101:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b25a40 x1876028970769152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121289.621112:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970769664 00000100:00100000:0.0:1789121289.621116:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970769664 00000100:00100000:3.0:1789121289.621126:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121289.621134:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789121289.621144:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789121289.621149:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789121289.621152:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946784ac0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789121289.621170:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789121289.621177:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970769152:0@lo:8:kworker.0 00000100:00100000:0.0:1789121289.621232:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121289.621237:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970769280:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789121289.621252:0:24941:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789121289.621292:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970769280:12345-0@lo:8:kworker.0 Request processed in 54us (306us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121289.621299:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121289.621309:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121289.621313:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970769664:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789121289.621341:0:24941:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789121289.621371:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970769664:12345-0@lo:8:kworker.0 Request processed in 55us (311us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121289.621378:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1789121289.621390:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121289.621397:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121289.621401:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970769280:0@lo:8:kworker.0 00000100:00080000:3.0:1789121289.621414:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121289.621420:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121289.621425:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970769664:0@lo:8:kworker.0 00000004:00080000:2.0:1789121289.621706:0:23454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789121289.621729:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23454:1876028970770304:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789121289.621763:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121289.621782:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121289.621794:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789121289.621804:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970770176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789121289.622157:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770304 00000100:00100000:1.0:1789121289.622163:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770304 00000100:00100000:1.0:1789121289.622217:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121289.622225:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23454:x1876028970770304:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789121289.622523:0:23453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789121289.622632:0:23453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 739811810550ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789121289.622639:0:23453:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1789121289.623097:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121289.623356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121289.623479:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770176 00000100:00100000:3.0:1789121289.623485:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770176 00000100:00100000:3.0:1789121289.623540:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121289.623550:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970770176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789121289.623572:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1789121289.623628:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970770176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121289.623636:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789121289.625656:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b25680 x1876028970770176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121289.625689:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970770176:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789121289.632294:0:23409:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789121289.644610:0:24942:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789121289.644632:0:24942:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1789121289.644641:0:24942:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:0.0:1789121289.656705:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.656718:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656736:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.656742:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.656749:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656768:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656779:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656787:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656855:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.656880:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.656887:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656895:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.656900:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656910:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656929:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.656937:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000071018fa/0xb74d2367a8311045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.658228:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.658233:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.658236:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121289.659343:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.659353:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659368:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.659373:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.659379:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659409:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659420:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659428:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659527:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.659543:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.659549:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659557:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.659562:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659571:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659590:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659597:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d985cf/0xb74d2367a831104c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.659622:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.659624:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.659626:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121289.661869:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.661882:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.661897:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.661903:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.661909:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.661923:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.661934:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.661942:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.663475:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121289.663496:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.663532:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ace00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121289.663539:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.663551:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.663581:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.663594:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.663596:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.663598:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.663659:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789121289.663673:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789121289.665377:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.665400:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.665416:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.665421:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.665428:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.665444:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.666335:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.666344:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.666381:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121289.667374:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.667382:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667396:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.667400:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.667406:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667418:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667433:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667439:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667542:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789121289.667554:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121289.667560:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667569:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ada00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.667573:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667583:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667601:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667609:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a831105a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667627:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.667637:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667644:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9aca00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.667646:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667653:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667663:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667670:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a8311061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.667682:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.667684:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.667685:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.669023:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121289.670239:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121289.670254:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.670276:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789121289.670282:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121289.670290:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.670311:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.670322:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.670329:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.670354:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.674436:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.674464:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.674479:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.674483:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.674515:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.674538:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.674546:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd4be8f/0xb74d2367a8311068 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.674572:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.674573:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.674575:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121289.683584:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.683602:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683621:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.683626:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.683633:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683649:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683659:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683684:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683711:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.683727:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.683733:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683741:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.683746:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683757:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683776:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.683783:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831106f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.684805:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.684812:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.684815:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121289.685717:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.685740:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685757:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.685761:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.685768:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685782:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685792:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685801:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685849:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.685862:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.685867:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685875:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ace00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.685880:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685888:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685914:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685921:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a8311076 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.685939:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.685940:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.685942:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121289.689721:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.689742:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.689766:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.689771:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.689779:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.689848:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.689864:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.689872:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.689907:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121289.690297:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121289.690307:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.690317:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121289.690323:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.690334:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.690357:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.690375:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a831107d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.690401:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.690403:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.690405:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121289.693539:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.693558:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.693582:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.693588:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.693597:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.693614:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.693626:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.693661:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.693689:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.695635:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.695654:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.695671:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.695678:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.695690:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.695715:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.695724:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a53ee7/0xb74d2367a8311084 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.695786:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.695791:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.695794:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121289.700763:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.700777:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.700795:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.702661:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.702675:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.702697:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.702711:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.702719:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.715630:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.716058:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.716068:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.716083:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.716098:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.716112:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.716147:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.716157:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a831108b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.716181:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.716183:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.716185:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121289.716686:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.716695:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.716709:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.716714:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.716721:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.716735:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.716744:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.716752:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.716814:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789121289.717195:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.717207:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.717215:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.717219:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.717223:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.717233:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.717241:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.717248:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721610:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121289.721626:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721641:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.721646:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721660:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721681:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721705:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023c99f38/0xb74d2367a8311092 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721726:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.721730:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721736:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.721740:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721748:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721757:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.721764:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.721765:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.721767:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.721857:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789121289.721865:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d6b7acd/0xb74d2367a8311099 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.722384:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121289.722596:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.722603:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.722616:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.722620:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.722634:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.722648:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.722658:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.722666:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.722715:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789121289.723962:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.723986:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.724002:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.724006:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.724012:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.724027:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.724037:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.724063:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729293:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121289.729308:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729322:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.729347:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729360:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729386:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729393:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6bf7c6/0xb74d2367a83110a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729434:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.729439:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729453:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.729457:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729464:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729474:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.729482:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.729490:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.729492:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.729709:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789121289.729719:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000349fffcb/0xb74d2367a83110a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.730366:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121289.730784:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121289.730794:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.730811:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=739s v=(0 0) 00010000:00010000:1.0:1789121289.730815:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121289.734325:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.734361:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.734375:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.734383:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.734690:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121289.735370:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.735384:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.735404:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.735410:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.735417:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.735431:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.735442:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.735451:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.743890:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121289.743906:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.743921:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.743927:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.743940:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.743967:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.743987:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f48a5ad2/0xb74d2367a83110ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.744014:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.744019:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.744026:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.744030:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.744061:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.744072:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.744081:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.744082:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.744084:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.746085:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121289.746107:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.746288:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121289.748450:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.748466:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.748487:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.748494:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.748501:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.748519:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.748531:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.748541:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.748569:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121289.751199:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.751219:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.751241:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.751246:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.751262:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.751281:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.751294:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.751302:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.751390:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789121289.752272:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.752281:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.752294:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.752298:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.752305:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.752316:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.752325:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.752348:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755285:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789121289.755307:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755324:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.755330:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755371:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755399:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755408:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a83110bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755444:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121289.755449:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755456:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.755460:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755468:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755477:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755485:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755576:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121289.755580:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755588:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.755591:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755599:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755611:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.755618:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.755620:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.755622:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121289.755799:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121289.755809:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.755847:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121289.756420:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.756429:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.756445:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.756450:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.756458:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.756472:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.756483:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.756554:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.756588:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121289.759812:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.759845:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.759863:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.759868:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.759875:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.759894:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.759908:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.759937:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.759959:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789121289.760590:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789121289.760607:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760622:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121289.760629:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760642:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760669:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760678:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a83110d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760731:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121289.760739:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760746:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121289.760751:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760782:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760793:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.760800:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de34c78a/0xb74d2367a83110d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789121289.761112:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.761124:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.761140:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.761144:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.761152:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.761168:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.761180:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.761190:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.761204:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121289.761477:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121289.763449:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.763457:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.763460:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121289.770752:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.770783:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.770805:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.770811:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.770863:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.770882:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.770893:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.770902:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.770922:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.771276:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.771291:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.771327:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.771332:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.771344:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.771372:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.771381:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a83110e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.771408:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.771410:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.771412:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.771952:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.771955:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.771957:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.772213:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.772226:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ace00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.772231:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.772240:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.772293:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.772302:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b447700f/0xb74d2367a83110df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.772321:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.772323:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.772325:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121289.772636:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.772647:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.772660:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.772672:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.772677:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.772689:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.772697:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.772702:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.772719:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.773059:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.773067:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.773077:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.773081:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.773090:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.773107:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.773115:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a83110ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.773148:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.773150:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.773152:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121289.773265:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121289.773273:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.773281:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=739s v=(0 0) 00010000:00010000:3.0:1789121289.773284:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121289.773288:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.773298:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.773306:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.773321:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121289.773405:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121289.774557:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.774567:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.774581:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.774585:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.774591:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.774603:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.774612:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.774620:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775434:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121289.775445:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775457:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.775469:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775481:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775502:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775510:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a83110f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775534:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121289.775538:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775545:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9aca00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.775549:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775557:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775566:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.775574:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.775582:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121289.775584:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.779855:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789121289.779877:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000363b8eb4/0xb74d2367a83110fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789121289.780574:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121289.780589:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.780606:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=739s v=(0 0) 00010000:00010000:0.0:1789121289.780611:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121289.780619:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.780636:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.780649:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.780657:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.780791:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121289.780801:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.780810:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ada00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121289.780816:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.782999:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.783031:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.783266:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.783270:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.783274:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.784926:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789121289.784945:0:24942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015756390/0xb74d2367a8311102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789121289.787107:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121289.787122:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.787143:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789121289.787149:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121289.787157:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.787175:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.787200:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.787209:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.787252:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121289.787451:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121289.787460:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.787470:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121289.787476:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.787494:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.787517:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.787526:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faefcc7c/0xb74d2367a8311109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121289.787547:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.787549:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121289.787551:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.787764:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121289.788062:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121289.788069:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788080:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789121289.788084:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121289.788089:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788100:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788108:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788116:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788150:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121289.788307:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121289.788314:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788323:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121289.788327:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788335:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788359:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788367:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f57b6480/0xb74d2367a8311110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788383:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.788385:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.788386:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121289.788461:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121289.788467:0:24942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788476:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=739s v=(0 0) 00010000:00010000:2.0:1789121289.788479:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121289.788483:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788492:0:24942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788500:0:24942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788508:0:24942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121289.788529:0:24942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789121289.788562:0:24942:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1789121289.788700:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23454:x1876028970770304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 166471us (166932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121289.788712:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1789121289.788782:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121289.788787:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788796:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121289.788800:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788808:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788855:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788864:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121289.788889:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.788891:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121289.788893:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121289.789027:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23454:1876028970770304:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789121289.789047:0:23454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789121289.789105:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23454:1876028970770432:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789121289.789151:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121289.789187:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9dee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121289.789237:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770432 00000100:00100000:2.0:1789121289.789251:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770432 00000100:00100000:2.0:1789121289.789306:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121289.789316:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23454:x1876028970770432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789121289.789362:0:24941:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1789121289.795234:0:24936:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1789121289.795312:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789121289.795589:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:23454:x1876028970770432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6266us (6430us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789121289.795604:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121289.795710:0:23454:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789121289.795720:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23454:1876028970770432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789121289.795741:0:23454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1789121289.810070:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121290.066525:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1789121290.115751:0:25757:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789121290.115757:0:25757:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789121290.115758:0:25757:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789121290.115925:0:25757:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946784a65800 00000020:01000004:2.0:1789121290.115947:0:25757:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789121290.115978:0:25757:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789121290.115997:0:25757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9468bac0ced8) 00000020:00000080:2.0:1789121290.116020:0:25757:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789121290.207794:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789121290.218654:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789121290.219479:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789121290.220409:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789121290.220782:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789121290.221653:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789121290.221905:0:25757:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1789121290.223665:0:25757:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789121290.224055:0:25757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789121290.224073:0:25757:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789121290.224088:0:25757:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a8311125 00000020:01000004:0.0:1789121290.224097:0:25757:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789121290.224123:0:25757:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789121290.224127:0:25757:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789121290.224144:0:25757:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789121290.224177:0:25757:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789121290.224182:0:25757:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789121290.236627:0:25757:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789121290.236673:0:25757:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789121290.236678:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789121290.236680:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121290.236681:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121290.236683:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121290.236684:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121290.236686:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121290.236688:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121290.236690:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121290.236691:0:25757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789121290.236695:0:25757:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789121290.236697:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789121290.236698:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121290.236700:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121290.236701:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121290.236702:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121290.236703:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121290.236704:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121290.236705:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121290.236706:0:25757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789121290.236733:0:25757:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789121290.236753:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789121290.238719:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.238780:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.239703:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770560 00000100:00100000:2.0:1789121290.239714:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770560 00000100:00100000:2.0:1789121290.239781:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789121290.239791:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:25757:x1876028970770560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121290.239879:0:23424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789121290.239884:0:23424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789121290.239887:0:23424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789121290.240608:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:25757:x1876028970770560:12345-0@lo:253:mount.lustre.0 Request processed in 815us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.240617:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789121290.240708:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789121290.240735:0:25757:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789121290.240739:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789121290.240741:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121290.240742:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121290.240743:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121290.240744:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121290.240745:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121290.240747:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121290.240749:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121290.240750:0:25757:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789121290.240772:0:25757:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946784a65800 from lustre-OST0001 10000000:01000000:1.0:1789121290.240806:0:25757:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789121290.240809:0:25757:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789121290.240846:0:25757:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946882bf0000 local copy 00010000:00010000:1.0:1789121290.240857:0:25757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121290.240976:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121290.241025:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.241062:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.241170:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770688 00000100:00100000:2.0:1789121290.241175:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770688 00000100:00100000:2.0:1789121290.241203:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789121290.241210:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:25757:x1876028970770688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121290.241294:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:25757:x1876028970770688:12345-0@lo:501:mount.lustre.0 Request processed in 83us (268us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789121290.241302:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789121290.241478:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789121290.241491:0:25757:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789121290.241507:0:25757:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789121290.241513:0:25757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121290.241522:0:25757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a8310d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310d66 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121290.241547:0:25757:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946784a65800 10000000:01000000:1.0:1789121290.241557:0:25757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789121290.241563:0:25757:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789121290.241565:0:25757:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789121290.241570:0:25757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789121290.241572:0:25757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789121290.241594:0:25757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121290.241602:0:25757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121290.241610:0:25757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121290.241622:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121290.241649:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.241671:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.241730:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770816 00000100:00100000:0.0:1789121290.241735:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770816 00000100:00100000:0.0:1789121290.241768:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789121290.241775:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:25757:x1876028970770816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121290.241785:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121290.241796:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8311133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831112c expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.241847:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8311133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831112c expref: 22 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.241860:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9aca00/0xb74d2367a8311133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831112c expref: 22 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.241878:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9aca00, rc 0) 00000100:00100000:0.0:1789121290.241932:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970770816:12345-0@lo:101:mount.lustre.0 Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.241939:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789121290.242038:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121290.242052:0:25757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311133 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.242060:0:25757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8311133 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121290.243703:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789121290.244513:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121290.248199:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789121290.248263:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789121290.248279:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789121290.248294:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789121290.248308:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789121290.248323:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789121290.248337:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789121290.248352:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789121290.248365:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789121290.248407:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789121290.248414:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789121290.248525:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121290.248602:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.248643:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689103ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.249237:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970770944 00000100:00100000:0.0:1789121290.249245:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970770944 00000100:00100000:0.0:1789121290.249304:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789121290.249314:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970770944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.249526:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970770944:12345-0@lo:501:mount.lustre.0 Request processed in 212us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.249535:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789121290.249980:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970770944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121290.250030:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121290.250085:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.250122:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689103ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121290.250218:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771072 00000100:00100000:1.0:1789121290.250224:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771072 00000100:00100000:1.0:1789121290.250264:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789121290.250273:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121290.251999:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771072:12345-0@lo:503:mount.lustre.0 Request processed in 1720us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.252013:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789121290.252183:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121290.252635:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121290.252721:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121290.252771:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.252810:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.253001:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771200 00000100:00100000:0.0:1789121290.253008:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771200 00000100:00100000:0.0:1789121290.253055:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789121290.253064:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.254445:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771200:12345-0@lo:502:mount.lustre.0 Request processed in 1376us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.254457:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789121290.254585:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121290.254804:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789121290.259538:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789121290.259569:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789121290.259582:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789121290.259597:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789121290.259622:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789121290.259637:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789121290.259649:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789121290.259662:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1789121290.259725:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121290.259863:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.260242:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.260336:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771328 00000100:00100000:2.0:1789121290.260344:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771328 00000100:00100000:2.0:1789121290.260408:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789121290.260419:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121290.260577:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771328:12345-0@lo:502:mount.lustre.0 Request processed in 160us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.260586:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789121290.260690:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121290.260761:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1789121290.260774:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789121290.265009:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789121290.265021:0:25761:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789121290.265036:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121290.265039:0:25761:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789121290.265046:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121290.265064:0:25761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff946783c7ced8) 00000020:00000080:3.0:1789121290.265099:0:25761:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789121290.265105:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789121290.265195:0:25761:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784a65800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789121290.265207:0:25761:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789121290.265214:0:25761:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a8311141 00010000:00010000:3.0:1789121290.273426:0:25761:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789121290.274989:0:25761:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1789121290.276705:0:25761:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1789121290.280353:0:25761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789121290.280369:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121290.280375:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121290.280377:0:25761:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789121290.280381:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121290.280386:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121290.280387:0:25761:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789121290.280390:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789121290.280392:0:25761:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789121290.280394:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121290.280396:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121290.280397:0:25761:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789121290.280399:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121290.280401:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121290.280402:0:25761:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789121290.280405:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789121290.280427:0:25761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121290.280430:0:25761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121290.280431:0:25761:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789121290.280434:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789121290.286087:0:25757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789121290.286295:0:25757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789121290.286321:0:25757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311133 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.286333:0:25757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a831112c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311133 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121290.286376:0:25757:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946784a65800 from 1 10000000:01000000:0.0:1789121290.286379:0:25757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789121290.286419:0:25757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.286428:0:25757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.286438:0:25757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121290.286466:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121290.286556:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.286605:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121290.286779:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771456 00000100:00100000:3.0:1789121290.286787:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771456 00000100:00100000:3.0:1789121290.288086:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789121290.288105:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:25757:x1876028970771456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121290.288123:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121290.288141:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311148 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.288171:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.288182:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.288192:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:3.0:1789121290.288267:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771456:12345-0@lo:101:mount.lustre.0 Request processed in 170us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.288274:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789121290.288558:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121290.288578:0:25757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.288587:0:25757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121290.289627:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:0.0:1789121290.291379:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121290.291649:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789121290.291675:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789121290.291688:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789121290.291701:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789121290.291713:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789121290.291737:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789121290.291750:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789121290.291764:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:0.0:1789121290.291777:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:0.0:1789121290.291788:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:0.0:1789121290.291800:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:0.0:1789121290.291812:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:0.0:1789121290.291847:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:0.0:1789121290.291861:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:0.0:1789121290.291872:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:0.0:1789121290.291899:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:0.0:1789121290.291913:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:0.0:1789121290.291930:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:0.0:1789121290.291935:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:0.0:1789121290.292053:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.294395:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.294498:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121290.296390:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771584 00000100:00100000:3.0:1789121290.296410:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771584 00000100:00100000:2.0:1789121290.296593:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789121290.296604:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121290.297701:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771584:12345-0@lo:501:mount.lustre.0 Request processed in 1095us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.297731:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789121290.297813:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.298055:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121290.298109:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.298165:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811cac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.298227:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771712 00000100:00100000:2.0:1789121290.298234:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771712 00000100:00100000:2.0:1789121290.298278:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789121290.298287:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121290.298397:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771712:12345-0@lo:503:mount.lustre.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.298404:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789121290.298741:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771712:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789121290.299178:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121290.299346:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.299390:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.299415:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.299479:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771840 00000100:00100000:2.0:1789121290.299484:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771840 00000100:00100000:2.0:1789121290.299525:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789121290.299533:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121290.299633:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771840:12345-0@lo:502:mount.lustre.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.299640:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789121290.299774:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121290.299994:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789121290.300018:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789121290.300030:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789121290.300042:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789121290.300053:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789121290.300064:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789121290.300076:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789121290.300086:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:0.0:1789121290.300096:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:0.0:1789121290.300107:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:0.0:1789121290.300294:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:0.0:1789121290.300327:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:0.0:1789121290.300342:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:0.0:1789121290.300354:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:0.0:1789121290.300368:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:0.0:1789121290.300383:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:0.0:1789121290.300394:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:0.0:1789121290.300418:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.300464:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.300547:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121290.300702:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970771968 00000100:00100000:3.0:1789121290.300708:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970771968 00000100:00100000:3.0:1789121290.300780:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789121290.300790:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121290.300921:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970771968:12345-0@lo:502:mount.lustre.0 Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.300928:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789121290.301023:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970771968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121290.301070:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:0.0:1789121290.301080:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789121290.301975:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.301987:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.301989:0:25765:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789121290.301996:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946784a65800 00000020:00000080:0.0:1789121290.301999:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302006:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302008:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302015:0:25765:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789121290.302019:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.302021:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302023:0:25765:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789121290.302026:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946784a65800 00000020:00000080:0.0:1789121290.302028:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302090:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302093:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302095:0:25765:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789121290.302097:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.302099:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302100:0:25765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121290.302104:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784a65800 00000020:00000080:0.0:1789121290.302107:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302136:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302139:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302140:0:25765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121290.302143:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.302145:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302147:0:25765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121290.302150:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784a65800 00000020:00000080:0.0:1789121290.302152:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302167:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302169:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302171:0:25765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121290.302174:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.302176:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302178:0:25765:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121290.302181:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784a65800 00000020:00000080:0.0:1789121290.302184:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302198:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302210:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302212:0:25765:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121290.302222:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121290.302224:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302225:0:25765:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789121290.302229:0:25765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784a65800 00000020:00000080:0.0:1789121290.302231:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121290.302255:0:25765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121290.302258:0:25765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121290.302259:0:25765:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789121290.302262:0:25765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:0.0:1789121290.302357:0:25757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789121290.302381:0:25757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789121290.302396:0:25757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.302409:0:25757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121290.302458:0:25757:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789121290.302462:0:25757:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946784a65800 10000000:01000000:0.0:1789121290.302465:0:25757:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946784a65800 10000000:01000000:0.0:1789121290.302469:0:25757:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789121290.302474:0:25757:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946784a65800 from 1 10000000:01000000:0.0:1789121290.302476:0:25757:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789121290.302511:0:25757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.302519:0:25757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.302530:0:25757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121290.302563:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121290.302635:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.307306:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.308238:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772096 00000100:00100000:2.0:1789121290.308249:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772096 00000100:00100000:2.0:1789121290.308315:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789121290.308325:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:25757:x1876028970772096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121290.308343:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121290.308364:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74800/0xb74d2367a831115d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311156 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121290.308394:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74800/0xb74d2367a831115d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311156 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121290.308406:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74800/0xb74d2367a831115d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311156 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121290.308422:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74800, rc 0) 00000100:00100000:2.0:1789121290.308500:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772096:12345-0@lo:101:mount.lustre.0 Request processed in 176us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.308506:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789121290.309985:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121290.310016:0:25757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831115d expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.310029:0:25757:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831115d expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121290.313979:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789121290.314495:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121290.314677:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789121290.314719:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789121290.314735:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789121290.314749:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789121290.314762:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789121290.314775:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789121290.314788:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789121290.314800:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789121290.314812:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789121290.314861:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789121290.314877:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789121290.314890:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789121290.314902:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789121290.314915:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789121290.314928:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789121290.314941:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789121290.314954:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789121290.315025:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789121290.315041:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789121290.315054:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789121290.315068:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789121290.315080:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789121290.315094:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789121290.315109:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789121290.318293:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789121290.318323:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789121290.318337:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789121290.318349:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789121290.318363:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789121290.318377:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789121290.318391:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789121290.318403:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789121290.318415:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789121290.318448:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789121290.318463:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789121290.318475:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789121290.318488:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789121290.318500:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789121290.318513:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789121290.318526:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789121290.318538:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789121290.318551:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789121290.318564:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789121290.318578:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789121290.318591:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789121290.318604:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789121290.318618:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789121290.318633:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789121290.321111:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789121290.325136:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789121290.325176:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789121290.325182:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789121290.325299:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.325375:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.325426:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890f29000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.326885:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772224 00000100:00100000:0.0:1789121290.326898:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772224 00000100:00100000:0.0:1789121290.332447:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789121290.332497:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.332721:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772224:12345-0@lo:501:mount.lustre.0 Request processed in 249us (7346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.332730:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789121290.332843:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121290.332897:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121290.332951:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.333028:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890f29000 going to sleep for 11 seconds 00000100:00100000:3.0:1789121290.333300:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772352 00000100:00100000:3.0:1789121290.333307:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772352 00000100:00100000:3.0:1789121290.333357:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789121290.333365:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121290.333508:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772352:12345-0@lo:503:mount.lustre.0 Request processed in 143us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.333516:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789121290.340856:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772352:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789121290.341375:0:25757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789121290.341467:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121290.341542:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.341598:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.344267:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772480 00000100:00100000:0.0:1789121290.344278:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772480 00000100:00100000:0.0:1789121290.344337:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789121290.344348:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.344530:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772480:12345-0@lo:502:mount.lustre.0 Request processed in 183us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.344538:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789121290.347286:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789121290.347571:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789121290.347603:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789121290.347618:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789121290.347632:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789121290.347644:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789121290.347656:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789121290.347681:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789121290.347695:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789121290.347708:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789121290.347721:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789121290.347734:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789121290.347745:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789121290.347757:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789121290.347768:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789121290.347781:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789121290.347792:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789121290.347804:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789121290.347817:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789121290.347852:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789121290.347865:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789121290.347877:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789121290.347890:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789121290.347912:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789121290.351103:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789121290.351148:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789121290.351162:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789121290.351175:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789121290.351187:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789121290.351200:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789121290.351214:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789121290.351248:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789121290.351261:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789121290.351275:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789121290.351289:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789121290.351302:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789121290.351314:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789121290.351327:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789121290.351340:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789121290.351371:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789121290.351388:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789121290.351401:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789121290.351414:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789121290.351427:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789121290.351441:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789121290.351453:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789121290.351465:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789121290.351476:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789121290.351490:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789121290.351556:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121290.351640:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.351697:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.354273:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772608 00000100:00100000:0.0:1789121290.354287:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772608 00000100:00100000:0.0:1789121290.354345:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789121290.354356:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.354522:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772608:12345-0@lo:502:mount.lustre.0 Request processed in 167us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.354530:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789121290.354862:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121290.355104:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789121290.356257:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789121290.356305:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.356378:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121290.356429:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772736 00000100:00100000:0.0:1789121290.356435:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772736 00000100:00100000:0.0:1789121290.356477:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789121290.356485:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121290.356582:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970772736:12345-0@lo:502:mount.lustre.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121290.356590:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789121290.356644:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468811ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121290.356665:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970772736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121290.356706:0:25757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789121290.356715:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789121290.366207:0:25771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789121290.366228:0:25771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff946783ca0000) 00000020:00000080:1.0:1789121290.366254:0:25771:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789121290.366345:0:25771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784a65800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789121290.366350:0:25771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946784a65800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789121290.366353:0:25771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784a65800 3 00010000:00080000:1.0:1789121290.366385:0:25771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468bc3a9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121290.368012:0:25771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789121290.368232:0:25771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789121290.368274:0:25771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789121290.368294:0:25771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb74d2367a831116b 00000100:00080000:1.0:1789121290.368305:0:25771:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121290.368311:0:25771:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9468bc3a9000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121290.368345:0:25771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468914d8780 x1876028970772864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121290.368374:0:25771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789121290.368579:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970772864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121290.368655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.372280:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772864 00000100:00100000:1.0:1789121290.372294:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772864 00000100:00100000:1.0:1789121290.372350:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789121290.372359:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970772864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789121290.372391:0:24965:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789121290.372453:0:24965:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb74d2367a8311172 00000004:00100000:1.0:1789121290.372471:0:24965:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789121290.372513:0:24965:0:(import.c:65:import_set_state_nolock()) ffff946783c74000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121290.372601:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876028970772864:12345-0@lo:38:llog_process_th.0 Request processed in 242us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.372609:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789121290.375334:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121290.375341:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121290.375344:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121290.375352:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:2.0:1789121290.375357:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789121290.375364:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121290.375388:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b24b40 x1876028970773248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121290.375429:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121290.375432:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121290.375434:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121290.375438:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 739 00000100:00080000:2.0:1789121290.375440:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789121290.375444:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121290.375454:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b26d00 x1876028970773760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121290.375495:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970772992:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.375565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.375601:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970773632:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.375636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.375662:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789121290.375668:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970773504:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.375691:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.375707:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970774144:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.375731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.375772:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970773120:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.375796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.375813:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970773888:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.376027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.376049:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789121290.376055:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970773376:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.376075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.376092:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970774016:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.376110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.376855:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970773248:0@lo:8:kworker.0 00000100:00100000:3.0:1789121290.376893:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.376919:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970773760:0@lo:8:kworker.0 00000100:00100000:3.0:1789121290.376937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789121290.376977:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468914d8780 x1876028970772864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121290.376987:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121290.376996:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789121290.377013:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789121290.377019:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789121290.377023:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bc3a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121290.377031:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970772864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121290.377076:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773632 00000100:00100000:3.0:1789121290.377082:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773632 00000100:00100000:3.0:1789121290.377138:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773120 00000100:00100000:3.0:1789121290.377142:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773120 00000100:00100000:3.0:1789121290.377154:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773248 00000100:00100000:3.0:1789121290.377156:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773248 00000100:00100000:3.0:1789121290.377165:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773760 00000100:00100000:3.0:1789121290.377167:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773760 00000100:00100000:3.0:1789121290.377177:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121290.377185:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970773632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121290.377238:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970773632:12345-0@lo:400:kworker.0 Request processed in 53us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.377246:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121290.377261:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121290.377267:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970773120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121290.377294:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970773120:12345-0@lo:400:kworker.0 Request processed in 27us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.377300:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121290.377311:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121290.377315:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970773248:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789121290.377360:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970773248:12345-0@lo:8:kworker.0 Request processed in 43us (466us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789121290.377367:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121290.377386:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121290.377390:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970773760:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789121290.377419:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970773760:12345-0@lo:8:kworker.0 Request processed in 28us (481us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789121290.377425:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789121290.377439:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121290.377454:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121290.377459:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121290.377463:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789121290.377466:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970773248:0@lo:8:kworker.0 00000100:00100000:3.0:1789121290.377474:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121290.377477:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121290.377480:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789121290.377482:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970773760:0@lo:8:kworker.0 00000100:00100000:1.0:1789121290.377872:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774144 00000100:00100000:1.0:1789121290.377877:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774144 00000100:00100000:1.0:1789121290.377918:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773888 00000100:00100000:1.0:1789121290.377922:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773888 00000100:00100000:1.0:1789121290.377933:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773376 00000100:00100000:1.0:1789121290.377936:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773376 00000100:00100000:1.0:1789121290.377947:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121290.377954:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970774144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121290.378004:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970774144:12345-0@lo:400:kworker.0 Request processed in 50us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.378011:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121290.378033:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121290.378039:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970773888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121290.378068:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970773888:12345-0@lo:400:kworker.0 Request processed in 29us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.378073:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121290.378084:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121290.378089:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970773376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121290.378175:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970773376:12345-0@lo:400:kworker.0 Request processed in 84us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.378181:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789121290.378957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970773120:0@lo:400:kworker.0 00010000:00080000:2.0:1789121290.378989:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b24780 x1876028970773888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121290.379000:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970773888:0@lo:400:kworker.0 00010000:00080000:2.0:1789121290.379026:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b27480 x1876028970773376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121290.379035:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970773376:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.379062:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970772992 00000100:00100000:2.0:1789121290.379080:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970772992 00000100:00080000:3.0:1789121290.379233:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121290.379275:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774016 00000100:00100000:1.0:1789121290.379280:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774016 00000100:00100000:1.0:1789121290.379319:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789121290.379327:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970774016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121290.379384:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970774016:12345-0@lo:400:kworker.0 Request processed in 58us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.379391:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789121290.379438:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121290.379892:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970773504 00000100:00100000:3.0:1789121290.379897:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970773504 00000100:00100000:3.0:1789121290.379921:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121290.379927:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970772992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121290.379979:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970772992:12345-0@lo:400:kworker.0 Request processed in 51us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.379985:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121290.379999:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121290.380005:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970773504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121290.380032:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970773504:12345-0@lo:400:kworker.0 Request processed in 28us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.380046:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789121290.380229:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970773504:0@lo:400:kworker.0 00010000:00080000:2.0:1789121290.380243:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b27840 x1876028970774144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121290.380252:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970774144:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.380263:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970772992:0@lo:400:kworker.0 00000100:00100000:2.0:1789121290.380275:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970773632:0@lo:400:kworker.0 00010000:00080000:2.0:1789121290.380331:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783b24000 x1876028970774016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121290.380341:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970774016:0@lo:400:kworker.0 00000020:01000004:1.0:1789121290.380507:0:25771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789121290.380524:0:25771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9467821e9a48) 00000020:00000080:1.0:1789121290.380547:0:25771:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789121290.380623:0:25771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784a65800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789121290.380628:0:25771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946784a65800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789121290.380630:0:25771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784a65800 3 00010000:00080000:1.0:1789121290.380660:0:25771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783c74800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121290.386468:0:25771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789121290.386744:0:25771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789121290.386794:0:25771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789121290.386813:0:25771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb74d2367a8311180 00000100:00080000:1.0:1789121290.386854:0:25771:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121290.386861:0:25771:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff946783c74800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121290.386901:0:25771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468914d8780 x1876028970774272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121290.386926:0:25771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789121290.390480:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970774272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121290.390566:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121290.390717:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774272 00000100:00100000:1.0:1789121290.390727:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774272 00000100:00100000:1.0:1789121290.390768:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789121290.390777:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970774272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789121290.390809:0:23429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789121290.390892:0:23429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb74d2367a8311187 00000004:00100000:1.0:1789121290.390908:0:23429:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789121290.390944:0:23429:0:(import.c:65:import_set_state_nolock()) ffff946783c75800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121290.391013:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876028970774272:12345-0@lo:38:llog_process_th.0 Request processed in 235us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121290.391021:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789121290.393808:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468914d8780 x1876028970774272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121290.393948:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121290.393959:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789121290.393980:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789121290.393986:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789121290.393990:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783c74800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121290.393998:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970774272:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789121290.395072:0:25771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789121290.395789:0:25757:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789121290.395842:0:25757:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789121290.395859:0:25757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831115d expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121290.395872:0:25757:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ada00/0xb74d2367a8311156 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831115d expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789121290.395924:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789121290.395927:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789121290.395928:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121290.395929:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121290.395930:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121290.395932:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121290.395933:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121290.395935:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121290.395937:0:25757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789121290.395940:0:25757:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789121290.395947:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121290.395948:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789121290.395949:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121290.395949:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121290.395950:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121290.395951:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121290.395952:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121290.395953:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121290.395954:0:25757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789121290.395992:0:25757:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789121290.396012:0:25757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970774400:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121290.396085:0:25757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121290.396302:0:25757:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121290.396323:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774400 00000100:00100000:2.0:1789121290.396330:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774400 00000100:00100000:2.0:1789121290.396381:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789121290.396391:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970774400:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121290.396416:0:23421:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789121290.396429:0:23421:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789121290.397698:0:23421:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789121290.397716:0:23421:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789121290.397851:0:23445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789121290.397856:0:23445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789121290.397877:0:23445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.397896:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831101b expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.397905:0:23445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311029 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.397912:0:23445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.397947:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.397988:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 24 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121290.398004:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970774528:0@lo:104: 00000100:00100000:3.0:1789121290.398065:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789121290.398100:0:23445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398169:0:23445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 24 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121290.398182:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970774656:0@lo:104: 00000100:00100000:3.0:1789121290.398205:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.398222:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e1386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121290.398248:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774528 00000100:00100000:3.0:1789121290.398254:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774528 00000100:00100000:3.0:1789121290.398282:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774656 00000100:00100000:3.0:1789121290.398285:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774656 00000100:00100000:3.0:1789121290.398298:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121290.398306:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970774528:12345-0@lo:104: 00010000:00010000:3.0:1789121290.398319:0:23412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398370:0:23412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121290.398376:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+4:23445:x1876028970774528:12345-0@lo:104: Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.398384:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121290.398401:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121290.398415:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970774656:12345-0@lo:104: 00010000:00010000:3.0:1789121290.398422:0:23412:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398455:0:23412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789121290.398459:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:23445:x1876028970774656:12345-0@lo:104: Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.398465:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121290.398507:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970774528:0@lo:104: 00000100:00100000:3.0:1789121290.398515:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23445:1876028970774656:0@lo:104: 00010000:00010000:3.0:1789121290.398533:0:23445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398550:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121290.398556:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398563:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121290.398567:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398575:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121290.398582:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121290.398588:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789121290.398616:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398628:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121290.398650:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398657:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac800/0xb74d2367a8311029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311030 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398669:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121290.398673:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398678:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9adc00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121290.398680:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398687:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121290.398693:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121290.398699:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789121290.398711:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398717:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121290.398731:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398737:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa9adc00/0xb74d2367a831101b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8311022 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.398754:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121290.398756:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121290.398757:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121290.398763:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121290.398774:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970774784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121290.398804:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.398860:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970774912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121290.398883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121290.398916:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774784 00000100:00100000:3.0:1789121290.398920:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774784 00010000:00010000:3.0:1789121290.398936:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 25 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121290.398956:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970774912 00000100:00100000:3.0:1789121290.398959:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970774912 00010000:00010000:3.0:1789121290.398984:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 26 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121290.398998:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121290.399004:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+26:3647:x1876028970774784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121290.399014:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121290.399019:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 26 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.399029:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 26 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.399043:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9acc00/0xb74d2367a8311030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8311029 expref: 26 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.399062:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121290.399094:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+25:3647:x1876028970774784:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.399100:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121290.399290:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:25757:x1876028970774400:12345-0@lo:253:mount.lustre.0 Request processed in 2899us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121290.399298:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789121290.399345:0:25757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:25757:1876028970774400:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121290.399355:0:25757:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789121290.399358:0:25757:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121290.399360:0:25757:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789121290.399361:0:25757:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121290.399362:0:25757:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121290.399363:0:25757:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121290.399364:0:25757:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121290.399365:0:25757:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121290.399373:0:25757:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121290.399374:0:25757:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789121290.399386:0:25757:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789121290.400300:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121290.400314:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:3644:x1876028970774912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121290.400326:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121290.400334:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 23 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400347:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 23 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400361:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e75800/0xb74d2367a8311022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831101b expref: 23 pid: 23424 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400374:0:23416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400382:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789121290.400396:0:23416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006394053s 00010000:00010000:3.0:1789121290.400400:0:23416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400407:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400426:0:23416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400432:0:23416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400438:0:23416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121290.400442:0:23416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.400449:0:23416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789121290.407721:0:25757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789121290.410051:0:25757:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789121290.410063:0:25757:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789121290.410101:0:25757:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789121290.410218:0:25757:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789121290.410242:0:25757:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789121290.410263:0:25757:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789121290.411109:0:25757:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121290.412543:0:25757:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789121290.416407:0:23445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121290.416425:0:23445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.420929:0:23416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.420947:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0e00/0xb74d2367a831118e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121290.420983:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121290.421084:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:3644:x1876028970774912:12345-0@lo:103:ldlm_bl.0 Request processed in 20771us (22196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121290.421096:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121290.421168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970774784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121290.425307:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970774912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121290.834195:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789121291.344789:0:25826:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789121291.346651:0:25826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121291.858487:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789121292.113915:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789121292.113924:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946891f07000 from 14 10000000:01000000:2.0:1789121292.113929:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121292.113992:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121292.114005:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121292.114017:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121292.114047:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121292.114132:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121292.114179:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121292.114526:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775040 00000100:00100000:0.0:1789121292.114545:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775040 00000100:00100000:0.0:1789121292.114604:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789121292.114614:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970775040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121292.114627:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121292.114642:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ac400/0xb74d2367a831119c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311195 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121292.114664:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ac400/0xb74d2367a831119c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311195 expref: 23 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121292.114674:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ac400/0xb74d2367a831119c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311195 expref: 23 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121292.114684:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ac400, rc 0) 00000100:00100000:0.0:1789121292.114737:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970775040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121292.114744:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789121292.115048:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121292.115064:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831119c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121292.115093:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831119c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121292.115213:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121292.115252:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121292.115442:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121292.115483:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775168 00000100:00100000:0.0:1789121292.115489:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775168 00000100:00100000:0.0:1789121292.115618:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789121292.115627:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970775168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121292.115644:0:23421:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121292.115663:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121292.115666:0:23421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789121292.115762:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970775168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121292.115769:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789121292.115980:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789121292.116049:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789121292.116057:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831119c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121292.116066:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e75a00/0xb74d2367a8311195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831119c expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121292.116075:0:23426:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789121292.116082:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468c076d800 from 14 10000000:01000000:1.0:1789121292.116085:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789121292.116216:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121292.116224:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121292.116232:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121292.116250:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121292.116401:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121292.116475:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789121292.116522:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775296 00000100:00100000:3.0:1789121292.116536:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775296 00000100:00100000:3.0:1789121292.116584:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789121292.116592:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970775296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121292.116602:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121292.116615:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0e00/0xb74d2367a83111aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83111a3 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121292.116636:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0e00/0xb74d2367a83111aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83111a3 expref: 24 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121292.116647:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0e00/0xb74d2367a83111aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83111a3 expref: 24 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121292.116655:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0e00, rc 0) 00000100:00100000:3.0:1789121292.116768:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970775296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121292.116775:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789121292.117118:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121292.117134:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83111aa expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121292.117143:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83111aa expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121292.117190:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789121292.117218:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121292.117244:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121292.117295:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775424 00000100:00100000:0.0:1789121292.117300:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775424 00000100:00100000:0.0:1789121292.117334:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789121292.117341:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970775424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121292.117353:0:23421:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121292.117366:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121292.117369:0:23421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789121292.117443:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970775424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121292.117449:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789121292.117511:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970775424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789121292.117572:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789121292.117580:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83111aa expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121292.117588:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2a00/0xb74d2367a83111a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83111aa expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121292.882309:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121293.714188:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970775552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121293.714265:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121293.714328:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775552 00000100:00100000:1.0:1789121293.714337:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775552 00000100:00100000:1.0:1789121293.714393:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121293.714412:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970775552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789121293.714444:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1789121293.714491:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970775552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121293.714499:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789121293.714523:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121293.714563:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970775552:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789121293.906178:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121294.232899:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970775680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121294.233000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121294.233058:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121294.233067:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970775808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121294.233111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121294.233158:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775680 00000100:00100000:0.0:1789121294.233166:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775680 00000100:00100000:0.0:1789121294.233213:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775808 00000100:00100000:0.0:1789121294.233216:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775808 00000100:00100000:0.0:1789121294.233235:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789121294.233246:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970775680:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121294.233294:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000004:00000024:0.0:1789121294.233302:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789121294.233317:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970775808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121294.233361:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121294.233686:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970775808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 378us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121294.233694:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789121294.233811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970775808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121294.233999:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970775680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 753us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121294.234010:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121294.234071:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970775680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121294.741385:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970775936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789121294.741480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121294.741627:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970775936 00000100:00100000:0.0:1789121294.741643:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970775936 00000100:00080000:1.0:1789121294.741841:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121294.745118:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121294.745174:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970775936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121294.745220:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121294.745453:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970775936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121294.745463:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121294.750626:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970775936:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789121294.934406:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121295.761958:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121295.761965:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121295.761969:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121295.761985:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783953000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121295.762012:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467839ed680 x1876028970776448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121295.762048:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121295.762052:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121295.762054:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121295.762059:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468a0872000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121295.763224:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467839ee940 x1876028970776960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121295.763292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970776064:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970776704:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763465:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970777344:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763506:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789121295.763511:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970776576:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763539:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970777216:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763576:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970776192:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763610:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970776832:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763642:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970777472:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763673:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789121295.763678:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970776320:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763708:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763731:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970777600:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.763748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.763770:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776704 00000100:00100000:2.0:1789121295.763776:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776704 00000100:00100000:2.0:1789121295.763815:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776192 00000100:00100000:3.0:1789121295.765166:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970776448:0@lo:8:kworker.0 00000100:00100000:3.0:1789121295.765238:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121295.765269:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970776960:0@lo:8:kworker.0 00000100:00100000:3.0:1789121295.765293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121295.765330:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776064 00000100:00100000:3.0:1789121295.765336:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776064 00000100:00100000:3.0:1789121295.765392:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789121295.765402:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3645:x1876028970776064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765463:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3645:x1876028970776064:12345-0@lo:400:kworker.0 Request processed in 62us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765472:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789121295.765511:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777344 00000100:00100000:3.0:1789121295.765517:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777344 00000100:00100000:3.0:1789121295.765552:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776576 00000100:00100000:3.0:1789121295.765556:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776576 00000100:00100000:3.0:1789121295.765570:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777216 00000100:00100000:3.0:1789121295.765573:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777216 00000100:00100000:3.0:1789121295.765588:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777472 00000100:00100000:3.0:1789121295.765591:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777472 00000100:00100000:3.0:1789121295.765603:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777088 00000100:00100000:3.0:1789121295.765606:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777088 00000100:00100000:3.0:1789121295.765615:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777600 00000100:00100000:3.0:1789121295.765617:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777600 00000100:00100000:3.0:1789121295.765635:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121295.765643:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970777344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765680:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970777344:12345-0@lo:400:kworker.0 Request processed in 38us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765687:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121295.765699:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789121295.765704:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970776576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765742:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970776576:12345-0@lo:400:kworker.0 Request processed in 37us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765748:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789121295.765759:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789121295.765765:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970777216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765792:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970777216:12345-0@lo:400:kworker.0 Request processed in 27us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765797:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789121295.765810:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121295.765816:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970777472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765868:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970777472:12345-0@lo:400:kworker.0 Request processed in 52us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765873:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121295.765883:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121295.765888:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765926:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970777088:12345-0@lo:400:kworker.0 Request processed in 27us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765932:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121295.765942:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121295.765947:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.765970:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970777600:12345-0@lo:400:kworker.0 Request processed in 23us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.765975:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121295.765991:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776832 00000100:00100000:3.0:1789121295.765994:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776832 00000100:00100000:3.0:1789121295.766019:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776320 00000100:00100000:3.0:1789121295.766022:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776320 00000100:00100000:3.0:1789121295.766030:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776448 00000100:00100000:3.0:1789121295.766032:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776448 00000100:00100000:3.0:1789121295.766038:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970776960 00000100:00100000:3.0:1789121295.766040:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776960 00000100:00100000:3.0:1789121295.766047:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121295.766052:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970776832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.766081:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970776832:12345-0@lo:400:kworker.0 Request processed in 29us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.766087:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121295.766096:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121295.766101:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970776320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121295.766122:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970776320:12345-0@lo:400:kworker.0 Request processed in 21us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.766127:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121295.766135:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121295.766139:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970776448:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789121295.766166:0:24941:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1789121295.766190:0:24941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a83111b1 00002000:00100000:3.0:1789121295.766204:0:24941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff946782a1e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789121295.766208:0:24941:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789121295.766211:0:24941:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789121295.766403:0:24941:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789121295.766430:0:24941:0:(import.c:65:import_set_state_nolock()) ffff946782a1d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121295.766467:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970776448:12345-0@lo:8:kworker.0 Request processed in 326us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.766481:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121295.766492:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789121295.766497:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970776960:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789121295.766510:0:24941:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 745 last 0 00000020:00000080:3.0:1789121295.766524:0:24941:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a83111b8 00002000:00100000:3.0:1789121295.766530:0:24941:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff946782a1f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789121295.766533:0:24941:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789121295.766535:0:24941:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789121295.766554:0:24941:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789121295.766574:0:24941:0:(import.c:65:import_set_state_nolock()) ffff946783cb7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121295.766598:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970776960:12345-0@lo:8:kworker.0 Request processed in 99us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.766604:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789121295.768034:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ed680 x1876028970776448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121295.768054:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789121295.768062:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789121295.768068:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789121295.768071:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789121295.768087:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789121295.768093:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970776448:0@lo:8:kworker.0 00010000:00080000:0.0:1789121295.768108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ee940 x1876028970776960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121295.768117:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789121295.768122:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789121295.768124:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789121295.768126:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0872000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789121295.768136:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789121295.768140:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970776960:0@lo:8:kworker.0 00000100:00080000:0.0:1789121295.768168:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121295.768172:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121295.768175:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1789121295.768194:0:23455:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789121295.768268:0:23455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 745957447138ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789121295.768281:0:23455:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789121295.768333:0:24176:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789121295.768352:0:24176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970777856:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789121295.768404:0:24176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121295.768427:0:24176:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784a9a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789121295.768548:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970777728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121295.768574:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121295.768604:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777856 00000100:00100000:0.0:1789121295.768610:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777856 00000100:00100000:0.0:1789121295.768651:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121295.768659:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24176:x1876028970777856:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789121295.768851:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777728 00000100:00100000:0.0:1789121295.768854:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777728 00000100:00100000:0.0:1789121295.768879:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121295.768885:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876028970777728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121295.768902:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121295.768961:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876028970777728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121295.768969:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789121295.768989:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789121295.769008:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848fad00 x1876028970777728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769024:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970777728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121295.769055:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970776320:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769069:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec3c0 x1876028970777088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769084:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970777088:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769102:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784897480 x1876028970777600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769111:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970777600:0@lo:400:kworker.0 00000100:00100000:0.0:1789121295.769125:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970776832:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769139:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784895680 x1876028970777472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769146:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970777472:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769183:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970776576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970776576:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ed2c0 x1876028970777216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970777216:0@lo:400:kworker.0 00000100:00100000:0.0:1789121295.769223:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3645:1876028970776064:0@lo:400:kworker.0 00010000:00080000:0.0:1789121295.769240:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ef0c0 x1876028970777344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.769249:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970777344:0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.769837:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970776192 00000100:00100000:2.0:1789121295.769870:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789121295.769878:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.769953:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970776704:12345-0@lo:400:kworker.0 Request processed in 77us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121295.769961:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789121295.769976:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789121295.769982:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970776192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121295.770016:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970776192:12345-0@lo:400:kworker.0 Request processed in 34us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121295.770022:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789121295.772302:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970776192:0@lo:400:kworker.0 00000100:00100000:0.0:1789121295.772346:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970776704:0@lo:400:kworker.0 00000004:00080000:0.0:1789121295.774187:0:23409:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789121295.778348:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970777984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121295.778432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789121295.778509:0:23456:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789121295.778541:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23456:1876028970778112:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789121295.778579:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121295.778598:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783af2e40 going to sleep for 11 seconds 00000004:00080000:3.0:1789121295.778617:0:24175:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789121295.778723:0:24175:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 745967901281ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789121295.778731:0:24175:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789121295.778766:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970777984 00000100:00100000:3.0:1789121295.778774:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970777984 00000100:00100000:3.0:1789121295.778862:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121295.778874:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970777984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789121295.778897:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121295.782232:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970777984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3351us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.782255:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121295.782304:0:24942:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789121295.782313:0:24942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1789121295.782739:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789121295.783627:0:24164:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1789121295.784235:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5cb40 x1876028970777984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121295.784265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970777984:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789121295.790424:0:24941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789121295.790442:0:24941:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789121295.790550:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24176:x1876028970777856:12345-0@lo:7:osp-pre-1-1.0 Request processed in 21887us (22141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121295.790562:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789121295.790599:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778112 00000100:00100000:3.0:1789121295.790607:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778112 00000100:00100000:3.0:1789121295.790652:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789121295.790661:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23456:x1876028970778112:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1789121295.791219:0:24176:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848fa1c0 x1876028970777856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789121311 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121295.791237:0:24176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970777856:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789121295.791253:0:24176:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789121295.791295:0:24176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970778240:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789121295.791338:0:24176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.791361:0:24940:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789121295.791366:0:24176:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783af2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121295.791371:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778240 00000100:00100000:2.0:1789121295.791375:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778240 00002000:00080000:3.0:1789121295.792337:0:24941:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789121295.792345:0:24941:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1789121295.792351:0:24941:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00010000:3.0:1789121295.799495:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.799513:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799543:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.799549:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.799557:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799579:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799593:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799602:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799626:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.799644:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.799652:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799659:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.799664:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799674:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799704:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799712:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000942b383b/0xb74d2367a83111bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.799732:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.799734:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.799736:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.800197:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.800203:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800214:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.800217:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.800222:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800231:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800240:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800247:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800279:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.800291:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.800298:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.800306:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.800310:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.800318:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.800332:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.800351:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009ccb26a/0xb74d2367a83111c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.800368:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.800370:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.800372:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.800853:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.800860:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800869:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.800872:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.800876:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800886:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800895:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800902:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.800929:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121295.805477:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121295.805491:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.805507:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121295.805512:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.805525:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.805550:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.805558:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000398c3428/0xb74d2367a83111cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.805577:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.805579:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.805581:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.808163:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.808181:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808201:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.808215:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.808224:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808242:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808255:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808265:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808286:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.808302:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.808309:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808318:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.808322:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808332:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808350:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808371:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2b70561/0xb74d2367a83111d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.808396:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.808398:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.808400:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.809386:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.809396:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809408:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.809413:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.809419:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809432:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809443:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809451:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809480:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121295.809868:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.809881:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809891:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.809894:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.809899:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809910:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809931:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809938:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809956:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789121295.809966:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121295.809972:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809981:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.809985:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.809994:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810019:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810027:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba218ca4/0xb74d2367a83111db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810045:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.810049:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810056:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.810060:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810598:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810612:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810620:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006da8741b/0xb74d2367a83111e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.810637:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.810638:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.810649:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.811160:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.811167:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811177:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.811180:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.811185:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811195:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811202:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811209:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811223:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.811233:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.811237:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811244:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.811247:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811265:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811276:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811283:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a83111e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811297:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.811299:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.811301:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.811556:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.811632:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.811638:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811646:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.811649:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.811654:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811662:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811670:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811683:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.811737:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121295.812424:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.812432:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.812443:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=745s v=(0 0) 00010000:00010000:3.0:1789121295.812446:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.812451:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.812462:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.812471:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.812478:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121295.812703:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789121295.812721:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24176:x1876028970778240:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789121295.812752:0:26049:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789121295.812866:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24176:x1876028970778240:12345-0@lo:5:osp-pre-1-1.0 Request processed in 151us (21526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121295.812874:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789121295.813128:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121295.813136:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813146:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121295.813151:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813161:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813182:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813190:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000525089e0/0xb74d2367a83111f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813207:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121295.813211:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813218:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121295.813221:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813229:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813246:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.813254:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.813256:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.813258:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.813423:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121295.813430:0:24941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a83111f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121295.813507:0:24176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970778240:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789121295.813522:0:24176:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789121295.813574:0:24176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970778368:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789121295.813624:0:24176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121295.813653:0:24176:0:(client.c:2715:ptlrpc_set_wait()) set ffff946884f74900 going to sleep for 11 seconds 00000100:00100000:3.0:1789121295.813767:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778368 00000100:00100000:3.0:1789121295.813773:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778368 00000100:00100000:3.0:1789121295.813809:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789121295.813816:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24176:x1876028970778368:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789121295.813873:0:24940:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:0.0:1789121295.818301:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.819966:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.819977:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.819996:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1789121295.820000:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.820008:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820023:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820034:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820053:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820078:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.820090:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.820095:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820104:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.820108:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820118:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820137:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820145:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a83111fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.820163:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.820165:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.820166:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.822536:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.822553:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822568:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1789121295.822574:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.822580:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822595:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822606:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822613:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822634:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.822647:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.822652:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822661:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.822666:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822674:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822699:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822706:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.822724:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.822726:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.822728:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121295.829449:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121295.829465:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.829484:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=746s v=(0 0) 00010000:00010000:0.0:1789121295.829488:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121295.829496:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.829511:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.829523:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.829531:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121295.829559:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.829753:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.829762:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.829771:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9acc00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.829775:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.829786:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.829804:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.829812:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fecbf2e/0xb74d2367a831120c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.829852:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.829854:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.829856:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.837892:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.837904:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.837945:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.837950:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.837957:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.837974:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.837986:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.837994:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.838019:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.838993:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.839004:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.839016:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.839021:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.839032:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.839052:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.839059:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311213 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.839152:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.839155:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.839157:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.839846:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.839855:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.839868:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.839871:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.839877:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.839889:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.839909:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.839927:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.840777:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.840859:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.840866:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.840875:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.840879:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.840888:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.840904:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.840911:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831121a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.840942:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.840943:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.840945:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121295.845404:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121295.845418:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845436:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1789121295.845469:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121295.845478:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845493:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845504:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845512:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845530:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.845663:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.845670:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845679:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.845684:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845705:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845725:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845733:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a8311221 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.845752:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.845754:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.845755:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.846071:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.846079:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.846087:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.846091:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.846094:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.846104:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.846112:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.846119:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.846153:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.846275:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.846281:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.846289:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.846293:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.846300:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.846312:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.846331:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e8867c5/0xb74d2367a8311228 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.846344:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.846346:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.846347:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.848667:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.848681:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848710:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1789121295.848715:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.848723:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848739:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848755:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848764:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848782:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.848981:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.848989:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.848998:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.849003:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849013:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849043:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849051:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f8c44d3/0xb74d2367a831122f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849077:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.849079:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.849081:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.849477:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.849484:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849494:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1789121295.849497:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.849502:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849513:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849522:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849528:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849554:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121295.849652:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121295.849658:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849666:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121295.849670:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849678:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849689:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849697:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8311236 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849711:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.849712:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121295.849714:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121295.849967:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121295.849973:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.849982:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1789121295.849991:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121295.849997:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.850007:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.850015:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.850022:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121295.850040:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.851017:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.851026:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851036:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.851040:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851049:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851066:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851074:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3039b4f/0xb74d2367a831123d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851096:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.851098:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.851100:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.851322:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.851329:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.851340:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.851344:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.851350:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.851362:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.851370:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.851378:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.851406:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.851611:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.851617:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851625:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.851629:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851638:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851651:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851659:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc6bf7c6/0xb74d2367a8311244 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.851675:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.851677:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.851678:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.852787:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.852797:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.852812:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.852847:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.852854:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.852866:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.852876:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.852884:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.852903:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.853096:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.853104:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.853112:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.853116:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.853136:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.853153:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.853163:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb4be2aa/0xb74d2367a831124b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.853183:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.853185:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.853186:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.853973:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.853983:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.853996:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.854000:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.854006:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.854018:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.854027:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.854043:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.854059:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.854235:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.854242:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.854250:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.854255:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.854264:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.854280:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.854299:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023c99f38/0xb74d2367a8311252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.854316:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.854318:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.854319:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121295.855598:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121295.855608:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855623:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1789121295.855627:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121295.855634:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855646:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855656:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855664:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855680:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.855793:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.855804:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.855811:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.855816:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856172:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856189:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856195:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd4be8f/0xb74d2367a8311259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856210:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.856211:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.856213:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.856271:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.856278:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.856287:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.856290:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.856294:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.856304:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.856312:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.856318:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.856330:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.856541:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.856548:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856556:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.856560:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856579:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856591:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856598:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a8311260 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.856612:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.856614:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.856615:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.857276:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.857283:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857301:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.857305:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.857310:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857321:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857331:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857339:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857365:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789121295.857643:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.857649:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857658:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.857661:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.857666:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857675:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857695:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857703:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857720:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789121295.857728:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789121295.857734:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857742:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121295.857746:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857754:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857769:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857777:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6b7acd/0xb74d2367a8311267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857794:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121295.857803:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857809:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121295.857812:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857845:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857856:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857863:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2f391e4/0xb74d2367a831126e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.857875:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121295.857876:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121295.857878:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.858162:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.858169:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858178:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.858182:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.858187:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858209:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858218:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858226:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858241:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121295.858249:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121295.858253:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858260:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121295.858263:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858273:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858284:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858293:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a8311275 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.858312:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121295.858314:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121295.858316:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.858400:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.859589:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.859598:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.859612:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.859616:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.859622:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.859634:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.859644:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.859652:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.859672:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121295.859790:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.859798:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.859805:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.859810:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.859888:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.859906:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.859930:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7e9755b/0xb74d2367a831127c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.859948:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.859949:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.859951:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121295.863566:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121295.863585:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.863616:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=746s v=(0 0) 00010000:00010000:1.0:1789121295.863621:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121295.863628:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.863645:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.863656:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.863664:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121295.863724:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1789121295.869110:0:25758:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789121295.869157:0:25758:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789121295.869164:0:25758:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789121295.869337:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:24176:x1876028970778368:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55515us (55707us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789121295.869349:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789121295.869363:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.869374:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.869388:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.869393:0:23417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.869406:0:23417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.869430:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.869438:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a8311283 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.869460:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.869462:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.869464:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121295.869500:0:24176:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789121295.869508:0:24176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24176:1876028970778368:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789121295.869524:0:24176:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1789121295.869577:0:24176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24176:1876028970778496:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789121295.869613:0:24176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121295.869648:0:24176:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784a9a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789121295.869709:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778496 00000100:00100000:2.0:1789121295.869718:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778496 00000100:00100000:2.0:1789121295.869763:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121295.869773:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24176:x1876028970778496:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789121295.869848:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24176:x1876028970778496:12345-0@lo:900:osp-pre-1-1.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121295.869855:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789121295.869886:0:24176:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839eed00 x1876028970778496/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121311 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121295.869898:0:24176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24176:1876028970778496:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789121295.870339:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121295.870347:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870362:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1789121295.870366:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121295.870374:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870387:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870397:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870406:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870427:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789121295.870796:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121295.870803:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870811:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1789121295.870814:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121295.870847:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870859:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870867:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870875:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.870890:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789121295.871140:0:24941:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121295.871146:0:24941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871154:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1789121295.871163:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121295.871168:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871178:0:24941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871186:0:24941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871193:0:24941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871207:0:24941:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1789121295.871423:0:24941:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1789121295.871492:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:23456:x1876028970778112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80829us (92909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121295.871500:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1789121295.871534:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789121295.871542:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871551:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.871556:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871566:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871588:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871596:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f57b6480/0xb74d2367a831128a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871615:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121295.871618:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871624:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e75800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.871628:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871636:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871644:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871651:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e2f118c/0xb74d2367a8311291 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871661:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121295.871665:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871676:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121295.871679:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871687:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871695:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871702:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc3b3e7d/0xb74d2367a8311298 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121295.871713:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.871714:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121295.871716:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121295.871746:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23456:1876028970778112:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789121295.871760:0:23456:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789121295.871799:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23456:1876028970778624:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789121295.871850:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121295.871873:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121295.871889:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778624 00000100:00100000:2.0:1789121295.871895:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778624 00000100:00100000:2.0:1789121295.871943:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121295.871952:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:23456:x1876028970778624:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789121295.871994:0:26049:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1789121295.872189:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121295.874022:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121295.879174:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23456:x1876028970778624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7215us (7315us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789121295.879189:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789121295.880870:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23456:1876028970778624:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789121295.880893:0:23456:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1789121295.953958:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121296.985328:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789121297.299346:0:26118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1789121297.501306:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789121298.003266:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789121298.254501:0:26172:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121298.257470:0:26172:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789121298.840861:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970778752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121298.840944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121298.841212:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778752 00000100:00100000:2.0:1789121298.841222:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778752 00000100:00100000:2.0:1789121298.841294:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121298.841305:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970778752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121298.841337:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121298.841385:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970778752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121298.841391:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789121298.841446:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121298.841481:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970778752:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789121299.035938:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121299.364686:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121299.364713:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970778880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121299.364813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121299.364903:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121299.364913:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970779008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121299.364943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121299.364989:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970778880 00000100:00100000:1.0:1789121299.364996:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970778880 00000100:00100000:1.0:1789121299.365041:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779008 00000100:00100000:1.0:1789121299.365045:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779008 00000100:00100000:1.0:1789121299.365079:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121299.365087:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970778880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121299.365128:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789121299.365176:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970778880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121299.365184:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121299.365203:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121299.365209:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970779008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121299.365227:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121299.365259:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970779008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121299.365265:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121299.365347:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970779008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121299.365380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970778880:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789121299.589741:0:26222:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121299.590010:0:26222:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789121299.860291:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121299.860315:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121299.860389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121299.860435:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779136 00000100:00100000:2.0:1789121299.860442:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779136 00000100:00100000:2.0:1789121299.860500:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121299.860510:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970779136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789121299.860536:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121299.860581:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970779136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121299.860597:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789121299.860620:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121299.860659:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789121299.985240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121299.985377:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587072 00000100:00100000:3.0:1789121299.985390:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587072 00000100:00100000:3.0:1789121299.985445:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789121299.985454:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2408:x1876028947587072:12345-192.168.202.32@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789121299.985486:0:23424:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b3dee28e-700e-4632-b33d-fd4587623bcd@192.168.202.32@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:3.0:1789121299.985514:0:23424:0:(genops.c:1385:class_connect()) connect: client b3dee28e-700e-4632-b33d-fd4587623bcd, cookie 0xb74d2367a831129f 00000100:00080000:3.0:1789121299.985684:0:23424:0:(import.c:65:import_set_state_nolock()) ffff946783cb2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121299.985814:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+5:2408:x1876028947587072:12345-192.168.202.32@tcp:250:mount.lustre.0 Request processed in 359us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121299.985855:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:1.0:1789121300.004051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.004256:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587200 00000100:00100000:3.0:1789121300.004266:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587200 00000100:00100000:3.0:1789121300.004318:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:3.0:1789121300.004345:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+5:18357:x1876028947587200:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789121300.004365:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121300.004382:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990200/0xb74d2367a83112a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef88 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.004412:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990200/0xb74d2367a83112a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef88 expref: 6 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.004423:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990200/0xb74d2367a83112a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef88 expref: 6 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.004433:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990200, rc 0) 00000100:00100000:3.0:1789121300.004487:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+6:18357:x1876028947587200:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 144us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.004494:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:1.0:1789121300.006293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.006372:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587328 00000100:00100000:3.0:1789121300.006381:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587328 00000100:00100000:3.0:1789121300.006436:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:3.0:1789121300.006446:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+6:18357:x1876028947587328:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789121300.006571:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+6:18357:x1876028947587328:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 126us (287us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789121300.006580:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789121300.015330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.016015:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587456 00000100:00100000:3.0:1789121300.016026:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587456 00000100:00100000:3.0:1789121300.016080:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:3.0:1789121300.016089:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+6:18357:x1876028947587456:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789121300.016108:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121300.016136:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990e00/0xb74d2367a83112ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef8f expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.016164:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990e00/0xb74d2367a83112ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef8f expref: 7 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.016176:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990e00/0xb74d2367a83112ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef8f expref: 7 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.016185:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990e00, rc 0) 00000100:00100000:3.0:1789121300.016243:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9451850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+7:18357:x1876028947587456:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 154us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.016250:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:2.0:1789121300.024616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.024852:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587584 00000100:00100000:1.0:1789121300.024863:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587584 00000100:00100000:1.0:1789121300.024926:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:1.0:1789121300.024936:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+7:18357:x1876028947587584:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789121300.025119:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18357:x1876028947587584:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 183us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.025127:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:1.0:1789121300.033932:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.034003:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587712 00000100:00100000:3.0:1789121300.034031:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587712 00000100:00100000:3.0:1789121300.034116:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:3.0:1789121300.034129:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18357:x1876028947587712:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789121300.034345:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9450050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18357:x1876028947587712:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 217us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.034354:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00010000:00010000:2.0:1789121300.053981:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121300.063720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.063888:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587840 00000100:00100000:1.0:1789121300.063905:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587840 00000100:00100000:1.0:1789121300.063975:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:1.0:1789121300.063986:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947587840:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121300.064167:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9453c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947587840:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 182us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.064176:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:2.0:1789121300.107386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.107510:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947587968 00000100:00100000:1.0:1789121300.107521:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947587968 00000100:00100000:1.0:1789121300.107588:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:1.0:1789121300.107599:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947587968:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121300.107782:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947587968:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 184us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.107792:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:0.0:1789121300.118118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.118473:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588096 00000100:00100000:3.0:1789121300.118491:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588096 00000100:00100000:3.0:1789121300.118594:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:3.0:1789121300.118610:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947588096:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789121300.118890:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18375:x1876028947588096:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 284us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.118909:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:3.0:1789121300.131009:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.131157:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588224 00000100:00100000:1.0:1789121300.131174:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588224 00000100:00100000:1.0:1789121300.131250:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:1.0:1789121300.131262:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+8:18357:x1876028947588224:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789121300.131279:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121300.131298:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e22e00/0xb74d2367a83112b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7efc0 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121300.131327:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e22e00/0xb74d2367a83112b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc0 expref: 9 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121300.131338:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e22e00/0xb74d2367a83112b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc0 expref: 9 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121300.131358:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22e00, rc 0) 00000100:00100000:1.0:1789121300.131431:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+9:18357:x1876028947588224:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 172us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.131439:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:3.0:1789121300.144129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.144228:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588352 00000100:00100000:0.0:1789121300.144244:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588352 00000100:00100000:0.0:1789121300.144317:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:0.0:1789121300.144327:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+9:18357:x1876028947588352:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789121300.144355:0:23424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789121300.144380:0:23424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789121300.144384:0:23424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789121300.144387:0:23424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789121300.144390:0:23424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789121300.144393:0:23424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789121300.148936:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+9:18357:x1876028947588352:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 2909us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.148955:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:3.0:1789121300.153868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.153935:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588480 00000100:00100000:3.0:1789121300.153946:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588480 00000100:00100000:3.0:1789121300.154017:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:3.0:1789121300.154517:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+9:18357:x1876028947588480:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789121300.154542:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121300.154567:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7efc7 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.154813:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 10 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.154855:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 10 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121300.154866:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990a00, rc 0) 00000100:00100000:3.0:1789121300.154960:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18357:x1876028947588480:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 449us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.154968:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:3.0:1789121300.160880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.161015:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588608 00000100:00100000:1.0:1789121300.161029:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588608 00000100:00100000:1.0:1789121300.161100:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:1.0:1789121300.161109:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18357:x1876028947588608:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789121300.161284:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18357:x1876028947588608:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 175us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.161293:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:0.0:1789121300.164999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.165275:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588736 00000100:00100000:1.0:1789121300.165285:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588736 00000100:00100000:1.0:1789121300.165345:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:1.0:1789121300.165355:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946890829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18357:x1876028947588736:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789121300.165651:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946890829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18357:x1876028947588736:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 296us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.165660:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:1.0:1789121300.181665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.181844:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588864 00000100:00100000:3.0:1789121300.181854:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588864 00000100:00100000:3.0:1789121300.181927:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:3.0:1789121300.181939:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18380:x1876028947588864:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789121300.182108:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18380:x1876028947588864:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 171us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.182116:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:2.0:1789121300.195719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121300.196048:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947588992 00000100:00100000:1.0:1789121300.196060:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947588992 00000100:00100000:1.0:1789121300.196135:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:1.0:1789121300.196146:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18380:x1876028947588992:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121300.196312:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18380:x1876028947588992:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 167us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.196327:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789121300.212677:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.212768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121300.212983:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589120 00000100:00100000:2.0:1789121300.212993:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589120 00000100:00100000:2.0:1789121300.213046:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589376 00000100:00100000:2.0:1789121300.213050:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589376 00000100:00100000:2.0:1789121300.213074:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789121300.213083:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1876028947589120:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789121300.213118:0:23430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1789121300.213175:0:23430:0:(genops.c:1385:class_connect()) connect: client e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff, cookie 0xb74d2367a83112c2 00000004:00100000:2.0:1789121300.213215:0:23430:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789121300.213427:0:23430:0:(import.c:65:import_set_state_nolock()) ffff946782980000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121300.213495:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2408:x1876028947589120:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 411us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.213517:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789121300.213538:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789121300.213543:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1876028947589376:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789121300.213560:0:23430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1789121300.213593:0:23430:0:(genops.c:1385:class_connect()) connect: client e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff, cookie 0xb74d2367a83112c9 00000004:00100000:2.0:1789121300.213606:0:23430:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789121300.213751:0:23430:0:(import.c:65:import_set_state_nolock()) ffff9467849f3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121300.213776:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2408:x1876028947589376:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 232us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.213783:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789121300.220662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121300.220696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121300.220852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.228120:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589632 00000100:00100000:0.0:1789121300.228137:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589632 00000100:00100000:0.0:1789121300.228219:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589504 00000100:00100000:0.0:1789121300.228224:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589504 00000100:00100000:0.0:1789121300.228240:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589248 00000100:00100000:0.0:1789121300.228242:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589248 00000100:00100000:0.0:1789121300.228263:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789121300.228274:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18357:x1876028947589632:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789121300.228318:0:23429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789121300.228415:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18357:x1876028947589632:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 143us (7762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.228424:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789121300.228452:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121300.228459:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:0:x1876028947589504:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789121300.228477:0:23429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789121300.228530:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:0:x1876028947589504:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 70us (7832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.228537:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121300.228549:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789121300.228555:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:0:x1876028947589248:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789121300.228566:0:23429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789121300.228586:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:0:x1876028947589248:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 31us (7734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.228592:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00080000:2.0:1789121300.230152:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121300.230160:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121300.240668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.240760:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589760 00000100:00100000:0.0:1789121300.240769:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589760 00000100:00100000:0.0:1789121300.240851:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789121300.240863:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947589760:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789121300.240963:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947589760:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 102us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.240972:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789121300.257254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.257301:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.257446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121300.257545:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947589888 00000100:00100000:2.0:1789121300.257555:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947589888 00000100:00100000:2.0:1789121300.257599:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590016 00000100:00100000:2.0:1789121300.257602:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590016 00000100:00100000:2.0:1789121300.257624:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789121300.257632:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947589888:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789121300.257670:0:24940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1789121300.257702:0:24940:0:(genops.c:1385:class_connect()) connect: client e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff, cookie 0xb74d2367a83112d0 00002000:00100000:2.0:1789121300.257715:0:24940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff/ffff9467849f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789121300.257727:0:24940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789121300.257968:0:24940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789121300.258002:0:24940:0:(import.c:65:import_set_state_nolock()) ffff9467849f1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121300.258076:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2408:x1876028947589888:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 442us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.258084:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789121300.258102:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789121300.258107:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947590016:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789121300.258134:0:24940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1789121300.258151:0:24940:0:(genops.c:1385:class_connect()) connect: client e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff, cookie 0xb74d2367a83112d7 00002000:00100000:2.0:1789121300.258157:0:24940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff/ffff9467849f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789121300.258171:0:24940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789121300.258338:0:24940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789121300.258357:0:24940:0:(import.c:65:import_set_state_nolock()) ffff9467849f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121300.258382:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2408:x1876028947590016:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 273us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.258390:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789121300.261253:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590144 00000100:00100000:3.0:1789121300.261268:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590144 00000100:00100000:2.0:1789121300.264776:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:2.0:1789121300.264802:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947590144:12345-192.168.202.32@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789121300.264932:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947590144:12345-192.168.202.32@tcp:900:mount.lustre.0 Request processed in 133us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.264940:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789121300.269797:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121300.269993:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590272 00000100:00100000:3.0:1789121300.270005:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590272 00000100:00100000:3.0:1789121300.270075:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789121300.270087:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947590272:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789121300.270683:0:23432:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 498us 00000004:00200000:3.0:1789121300.305478:0:23432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789121300.305631:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18357:x1876028947590272:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 35540us (35850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.305644:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000040:00080000:0.0:1789121300.314941:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789121300.496066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121300.496573:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590400 00000100:00100000:0.0:1789121300.496592:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590400 00000100:00100000:0.0:1789121300.496700:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789121300.496712:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18405:x1876028947590400:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:0.0:1789121300.496735:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121300.496762:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83112de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eff8 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.496881:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.496897:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.496913:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121300.496979:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789121300.496983:0:24965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789121300.497023:0:24965:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.497055:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83112de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eff8 expref: 8 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.497074:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eff8 expref: 7 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121300.497084:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:0.0:1789121300.497088:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789121300.497092:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ad600, rc 0) 00000100:00100000:0.0:1789121300.497158:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18405:x1876028947590400:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 447us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.497167:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789121300.882436:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779520:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.882562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.882607:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779520 00000100:00100000:2.0:1789121300.882617:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779520 00000100:00100000:3.0:1789121300.882645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970780032:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.882678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.882689:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780032 00000100:00100000:2.0:1789121300.882694:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780032 00000100:00100000:3.0:1789121300.882702:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970780544:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.882744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.882745:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121300.882759:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.882772:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789121300.882782:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779648:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.882845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.882852:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970779520:12345-0@lo:400:kworker.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.882862:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970780160:0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.882873:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121300.882895:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779648 00000100:00100000:2.0:1789121300.882908:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779648 00000100:00100000:3.0:1789121300.882913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.882930:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780160 00000100:00100000:2.0:1789121300.882933:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780160 00000100:00100000:2.0:1789121300.882947:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121300.882952:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970780032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.882986:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970780032:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.882992:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121300.883003:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121300.883009:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970779648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.883034:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970779648:12345-0@lo:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.883040:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121300.883049:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789121300.883054:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970780672:0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.883057:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970780160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.883100:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970780160:12345-0@lo:400:kworker.0 Request processed in 42us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.883101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121300.883110:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789121300.883141:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789121300.883146:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121300.883154:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779520:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.883166:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970780032:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.883189:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970779648:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.883196:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970780160:0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.883226:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780544 00000100:00100000:3.0:1789121300.883230:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780544 00000100:00080000:2.0:1789121300.883258:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121300.883286:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780672 00000100:00100000:3.0:1789121300.883291:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780672 00000100:00100000:2.0:1789121300.883293:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121300.883304:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970780544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.883326:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121300.883336:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970780672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121300.883352:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970780544:12345-0@lo:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121300.883359:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789121300.883380:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970780672:12345-0@lo:400:kworker.0 Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00080000:2.0:1789121300.883381:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121300.883390:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121300.883425:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970780672:0@lo:400:kworker.0 00010000:00080000:3.0:1789121300.883441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914df840 x1876028970780544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121300.883451:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970780544:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.883780:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970779264:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.883857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.883896:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970779776:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.883920:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.883954:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970780288:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.883975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.883993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970780800:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.884031:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789121300.884038:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970779392:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.884080:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970779904:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.884118:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121300.884181:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779776 00000100:00100000:1.0:1789121300.884185:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779776 00000100:00100000:1.0:1789121300.884207:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780288 00000100:00100000:1.0:1789121300.884210:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780288 00000100:00100000:1.0:1789121300.884220:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780800 00000100:00100000:1.0:1789121300.884223:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780800 00000100:00100000:1.0:1789121300.884242:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780416 00000100:00100000:1.0:1789121300.884245:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780416 00000100:00100000:1.0:1789121300.884261:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789121300.884268:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970779776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884314:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970779776:12345-0@lo:400:kworker.0 Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.884321:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789121300.884337:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789121300.884343:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970780288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884369:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970780288:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.884374:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789121300.884385:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121300.884405:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970780800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884433:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970780800:12345-0@lo:400:kworker.0 Request processed in 42us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.884439:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121300.884449:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121300.884455:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970780416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884786:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970780416:12345-0@lo:400:kworker.0 Request processed in 330us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.884793:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121300.884816:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779392 00000100:00100000:1.0:1789121300.884845:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779392 00000100:00100000:1.0:1789121300.884881:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779904 00000100:00100000:1.0:1789121300.884885:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779904 00000100:00100000:1.0:1789121300.884899:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789121300.884905:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970779392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.884955:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970779392:12345-0@lo:400:kworker.0 Request processed in 49us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.884970:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789121300.884984:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789121300.884990:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970779904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.885020:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970779904:12345-0@lo:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121300.885026:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789121300.885045:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789121300.885048:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121300.885084:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970779392:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.885096:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970779904:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.885107:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.885122:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970779776:0@lo:400:kworker.0 00000100:00100000:1.0:1789121300.885133:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970780288:0@lo:400:kworker.0 00010000:00080000:1.0:1789121300.885145:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914de580 x1876028970780800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121300.885156:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970780800:0@lo:400:kworker.0 00000100:00100000:0.0:1789121300.885544:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970780928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121300.885589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121300.885633:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970780928 00000100:00100000:0.0:1789121300.885638:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970780928 00000100:00100000:0.0:1789121300.885669:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121300.885676:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970780928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121300.885693:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121300.885729:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970780928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121300.885736:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121300.885770:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970780928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789121300.887533:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970779264 00000100:00100000:3.0:1789121300.887543:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970779264 00000100:00100000:3.0:1789121300.887607:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789121300.887616:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3646:x1876028970779264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121300.887712:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3646:x1876028970779264:12345-0@lo:400:kworker.0 Request processed in 97us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.887719:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789121300.887755:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121300.887770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970781056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121300.887799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121300.887862:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781056 00000100:00100000:3.0:1789121300.887877:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781056 00000100:00100000:3.0:1789121300.887905:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121300.887912:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970781056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789121300.887941:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121300.887980:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970781056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121300.887986:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121300.888026:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970781056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121300.888387:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970779264:0@lo:400:kworker.0 00010000:00010000:2.0:1789121301.076640:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789121301.908569:0:25758:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff 00000001:00080000:2.0:1789121301.908588:0:25758:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1789121302.098109:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121302.732191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121302.732307:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590528 00000100:00100000:1.0:1789121302.732317:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590528 00000100:00100000:2.0:1789121302.732505:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789121302.732520:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18458:x1876028947590528:12345-192.168.202.32@tcp:41:lfs.0 00000004:00000024:2.0:1789121302.732566:0:23431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789121302.732664:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18458:x1876028947590528:12345-192.168.202.32@tcp:41:lfs.0 Request processed in 148us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121302.732672:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00080000:1.0:1789121302.733277:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121302.742363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121302.742603:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590656 00000100:00100000:0.0:1789121302.742613:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590656 00000100:00080000:2.0:1789121302.742768:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789121302.742929:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789121302.742942:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18458:x1876028947590656:12345-192.168.202.32@tcp:41:lfs.0 00000004:00000024:0.0:1789121302.742981:0:23429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789121302.743067:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18458:x1876028947590656:12345-192.168.202.32@tcp:41:lfs.0 Request processed in 128us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121302.743075:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789121302.759573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121302.759670:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590784 00000100:00100000:3.0:1789121302.759679:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590784 00000100:00100000:3.0:1789121302.759740:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789121302.759749:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18458:x1876028947590784:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:3.0:1789121302.759778:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915845632 avail 3684323328 00000100:00080000:2.0:1789121302.759876:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121302.760019:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18458:x1876028947590784:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 271us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121302.760026:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789121302.775194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121302.775276:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947590912 00000100:00100000:3.0:1789121302.775299:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947590912 00000100:00100000:3.0:1789121302.775379:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789121302.775390:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:18458:x1876028947590912:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:3.0:1789121302.775427:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121302.775523:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:18458:x1876028947590912:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121302.775532:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00080000:2.0:1789121302.776252:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121303.051897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121303.051990:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591040 00000100:00100000:2.0:1789121303.052000:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591040 00000100:00100000:2.0:1789121303.052067:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:2.0:1789121303.052077:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+10:18491:x1876028947591040:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789121303.052095:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121303.052116:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74a00/0xb74d2367a83112ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7efff expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121303.052149:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74a00/0xb74d2367a83112ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efff expref: 11 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121303.052161:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74a00/0xb74d2367a83112ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efff expref: 11 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121303.052188:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74a00, rc 0) 00000100:00100000:2.0:1789121303.052247:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591040:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 171us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121303.052254:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:1.0:1789121303.057963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.058810:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591168 00000100:00100000:3.0:1789121303.058892:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591168 00000100:00100000:3.0:1789121303.058963:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:3.0:1789121303.058974:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591168:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789121303.059154:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591168:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 181us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.059163:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:0.0:1789121303.071766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.071902:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591296 00000100:00100000:3.0:1789121303.071919:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591296 00000100:00100000:3.0:1789121303.072027:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:3.0:1789121303.072042:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591296:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789121303.072270:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591296:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 231us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.072279:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:1.0:1789121303.081237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.083556:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591424 00000100:00100000:0.0:1789121303.083572:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591424 00000100:00100000:0.0:1789121303.083655:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:0.0:1789121303.083667:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591424:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789121303.083918:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591424:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 252us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.083927:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:0.0:1789121303.119740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.120343:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591552 00000100:00100000:1.0:1789121303.120384:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591552 00000100:00100000:1.0:1789121303.120473:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:1.0:1789121303.120486:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591552:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121303.120799:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591552:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 314us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.120808:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00010000:00010000:3.0:1789121303.122473:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121303.126773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.128720:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591680 00000100:00100000:0.0:1789121303.128737:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591680 00000100:00100000:0.0:1789121303.128885:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:0.0:1789121303.128898:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591680:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789121303.129102:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18497:x1876028947591680:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 204us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.129111:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:2.0:1789121303.140235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.140361:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591808 00000100:00100000:3.0:1789121303.140371:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591808 00000100:00100000:3.0:1789121303.140438:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:3.0:1789121303.140449:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18491:x1876028947591808:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789121303.140484:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121303.140517:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa991200/0xb74d2367a83112f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f030 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121303.140546:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa991200/0xb74d2367a83112f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f030 expref: 12 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121303.140558:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa991200/0xb74d2367a83112f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f030 expref: 12 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121303.140568:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991200, rc 0) 00000100:00100000:3.0:1789121303.140630:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18491:x1876028947591808:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 182us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.140637:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:2.0:1789121303.147487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.147666:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947591936 00000100:00100000:1.0:1789121303.147678:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947591936 00000100:00100000:1.0:1789121303.147740:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:1.0:1789121303.147750:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18491:x1876028947591936:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789121303.147782:0:23421:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789121303.147811:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789121303.147816:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789121303.147856:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789121303.147861:0:23421:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789121303.147863:0:23421:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789121303.149781:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18491:x1876028947591936:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 2021us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.149806:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:2.0:1789121303.162107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.162616:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592064 00000100:00100000:0.0:1789121303.162626:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592064 00000100:00100000:0.0:1789121303.162693:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:0.0:1789121303.162705:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18491:x1876028947592064:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789121303.162726:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121303.162747:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f037 expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121303.162778:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 13 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121303.162790:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 13 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121303.162961:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9adc00, rc 0) 00000100:00100000:0.0:1789121303.165103:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18491:x1876028947592064:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 2388us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.165117:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:2.0:1789121303.171037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.171143:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592192 00000100:00100000:1.0:1789121303.171153:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592192 00000100:00100000:1.0:1789121303.171213:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:1.0:1789121303.171224:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18491:x1876028947592192:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789121303.171391:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18491:x1876028947592192:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 168us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.171399:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:2.0:1789121303.182638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.183008:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592320 00000100:00100000:0.0:1789121303.183018:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592320 00000100:00100000:0.0:1789121303.183086:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:0.0:1789121303.183098:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18491:x1876028947592320:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789121303.183260:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18491:x1876028947592320:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 163us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.183269:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:2.0:1789121303.190276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.190537:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592448 00000100:00100000:3.0:1789121303.190548:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592448 00000100:00100000:3.0:1789121303.190611:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:3.0:1789121303.190621:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18499:x1876028947592448:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789121303.190806:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18499:x1876028947592448:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 173us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.190816:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:2.0:1789121303.198606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.198789:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592576 00000100:00100000:1.0:1789121303.198812:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592576 00000100:00100000:1.0:1789121303.198958:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:1.0:1789121303.198970:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18499:x1876028947592576:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121303.199161:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18499:x1876028947592576:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 192us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.199169:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:2.0:1789121303.203239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121303.203275:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121303.203334:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.203414:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592832 00000100:00100000:0.0:1789121303.203422:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592832 00000100:00100000:0.0:1789121303.203472:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592960 00000100:00100000:0.0:1789121303.203474:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592960 00000100:00100000:0.0:1789121303.203498:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789121303.203506:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2410:x1876028947592832:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121303.203573:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2410:x1876028947592832:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 68us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.203579:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789121303.203592:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789121303.203596:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2410:x1876028947592960:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121303.203611:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2410:x1876028947592960:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 15us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.203630:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:3.0:1789121303.203854:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593088 00000100:00100000:3.0:1789121303.203860:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593088 00000100:00100000:3.0:1789121303.203902:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789121303.203908:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2410:x1876028947593088:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121303.203936:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2410:x1876028947593088:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.203947:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:2.0:1789121303.206943:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121303.206980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.207083:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947592704 00000100:00100000:0.0:1789121303.207092:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947592704 00000100:00100000:0.0:1789121303.207135:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593344 00000100:00100000:0.0:1789121303.207138:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593344 00000100:00100000:0.0:1789121303.207166:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789121303.207175:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1876028947592704:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789121303.207207:0:23431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 82a2cd91-c608-4b81-82c0-46b7dff07711@192.168.202.32@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:0.0:1789121303.207246:0:23431:0:(genops.c:1385:class_connect()) connect: client 82a2cd91-c608-4b81-82c0-46b7dff07711, cookie 0xb74d2367a8311301 00000004:00100000:0.0:1789121303.207273:0:23431:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789121303.207374:0:23431:0:(import.c:65:import_set_state_nolock()) ffff946784b36000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121303.207440:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2408:x1876028947592704:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 264us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.207448:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789121303.207467:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789121303.207471:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1876028947593344:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789121303.207486:0:23431:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 82a2cd91-c608-4b81-82c0-46b7dff07711@192.168.202.32@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:0.0:1789121303.207523:0:23431:0:(genops.c:1385:class_connect()) connect: client 82a2cd91-c608-4b81-82c0-46b7dff07711, cookie 0xb74d2367a8311308 00000004:00100000:0.0:1789121303.207536:0:23431:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789121303.207581:0:23431:0:(import.c:65:import_set_state_nolock()) ffff946784b34000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121303.207607:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2408:x1876028947593344:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 135us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.207614:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789121303.215427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.215601:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593216 00000100:00100000:0.0:1789121303.215612:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593216 00000100:00100000:0.0:1789121303.215710:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789121303.215721:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:0:x1876028947593216:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789121303.215773:0:23431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789121303.215888:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:0:x1876028947593216:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.215896:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00080000:2.0:1789121303.215963:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121303.218057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.220895:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593600 00000100:00100000:3.0:1789121303.220913:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593600 00000100:00100000:3.0:1789121303.221155:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789121303.221172:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947593600:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789121303.221207:0:23429:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789121303.228929:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947593600:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 7748us (10867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.228954:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:2.0:1789121303.230311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.230438:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593472 00000100:00100000:1.0:1789121303.230448:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593472 00000100:00100000:1.0:1789121303.230540:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789121303.230552:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:0:x1876028947593472:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789121303.230596:0:24965:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121303.230670:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:0:x1876028947593472:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.230679:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00080000:3.0:1789121303.231269:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789121303.238325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.238438:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593728 00000100:00100000:1.0:1789121303.238449:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593728 00000100:00100000:1.0:1789121303.238552:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789121303.238563:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947593728:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789121303.238657:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947593728:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.238664:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789121303.244483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121303.244594:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593856 00000100:00100000:2.0:1789121303.244604:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593856 00000100:00100000:2.0:1789121303.244657:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789121303.244667:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1876028947593856:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789121303.244704:0:26049:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 82a2cd91-c608-4b81-82c0-46b7dff07711@192.168.202.32@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:2.0:1789121303.244766:0:26049:0:(genops.c:1385:class_connect()) connect: client 82a2cd91-c608-4b81-82c0-46b7dff07711, cookie 0xb74d2367a831130f 00002000:00100000:2.0:1789121303.244779:0:26049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82a2cd91-c608-4b81-82c0-46b7dff07711/ffff9467849f4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789121303.244987:0:26049:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789121303.248421:0:26049:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789121303.248477:0:26049:0:(import.c:65:import_set_state_nolock()) ffff946784b32000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121303.248582:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2408:x1876028947593856:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 3912us (4106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.248594:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789121303.251114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121303.251214:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947593984 00000100:00100000:3.0:1789121303.251224:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947593984 00000100:00100000:3.0:1789121303.251273:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789121303.251282:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947593984:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789121303.251319:0:24940:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 82a2cd91-c608-4b81-82c0-46b7dff07711@192.168.202.32@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:3.0:1789121303.251351:0:24940:0:(genops.c:1385:class_connect()) connect: client 82a2cd91-c608-4b81-82c0-46b7dff07711, cookie 0xb74d2367a8311316 00002000:00100000:3.0:1789121303.251363:0:24940:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 82a2cd91-c608-4b81-82c0-46b7dff07711/ffff946783cb7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789121303.251376:0:24940:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789121303.251457:0:24940:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789121303.251488:0:24940:0:(import.c:65:import_set_state_nolock()) ffff946783cb4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121303.251558:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2408:x1876028947593984:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 275us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121303.251567:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789121303.253364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.253459:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594112 00000100:00100000:0.0:1789121303.253468:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594112 00000100:00100000:0.0:1789121303.253527:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789121303.253537:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947594112:12345-192.168.202.32@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789121303.253627:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947594112:12345-192.168.202.32@tcp:900:mount.lustre.0 Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.253635:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789121303.264276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121303.265300:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594240 00000100:00100000:0.0:1789121303.265315:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594240 00000100:00100000:0.0:1789121303.265377:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789121303.265388:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947594240:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789121303.265495:0:23433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789121303.265614:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18491:x1876028947594240:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 227us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121303.265622:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:3.0:1789121303.504934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121303.505159:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594368 00000100:00100000:1.0:1789121303.505171:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594368 00000100:00100000:1.0:1789121303.505242:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789121303.505261:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:18524:x1876028947594368:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:1.0:1789121303.505283:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121303.505307:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a831131d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f068 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505382:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505398:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505412:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121303.505462:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789121303.505465:0:24965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789121303.505488:0:24965:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505516:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a831131d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 8 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505536:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 7 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121303.505545:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:1.0:1789121303.505548:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121303.505552:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23400, rc 0) 00000100:00100000:1.0:1789121303.505625:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+7:18524:x1876028947594368:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 366us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121303.505643:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121303.958480:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121303.958513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970781184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121303.958609:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121303.958982:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781184 00000100:00100000:2.0:1789121303.958992:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781184 00000100:00100000:2.0:1789121303.959079:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121303.959090:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970781184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121303.959134:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121303.959184:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970781184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121303.959192:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789121303.959406:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970781184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789121303.959434:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789121304.146675:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121304.466191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970781312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121304.466270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121304.466332:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121304.466339:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970781440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121304.466364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121304.466654:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781312 00000100:00100000:1.0:1789121304.466663:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781312 00000100:00100000:1.0:1789121304.466715:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781440 00000100:00100000:1.0:1789121304.466718:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781440 00000100:00100000:1.0:1789121304.466746:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789121304.466757:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970781312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121304.466795:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121304.466897:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970781312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121304.466904:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789121304.466924:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789121304.466930:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970781440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121304.466960:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789121304.467001:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970781440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121304.467008:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789121304.467120:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970781440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121304.467135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970781312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121304.986022:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789121304.986047:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970781568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121304.986120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121304.986165:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781568 00000100:00100000:0.0:1789121304.986173:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781568 00000100:00100000:0.0:1789121304.986233:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789121304.986242:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970781568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121304.986267:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121304.986310:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970781568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121304.986330:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789121304.986352:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121304.986388:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970781568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789121305.175350:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121306.002117:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121306.002145:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970781696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121306.002222:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.002337:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781696 00000100:00100000:0.0:1789121306.002346:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781696 00000100:00100000:0.0:1789121306.002433:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121306.002444:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970781696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121306.002476:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121306.002530:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970781696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121306.002538:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789121306.002585:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970781696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789121306.002769:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789121306.006960:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970782208:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007080:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970782720:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970783232:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007166:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789121306.007173:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970782080:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007217:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970782592:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007268:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970783104:0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.007286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121306.007318:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783232 00000100:00100000:2.0:1789121306.007325:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783232 00000100:00100000:2.0:1789121306.007391:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783104 00000100:00100000:2.0:1789121306.007395:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783104 00000100:00100000:0.0:1789121306.007802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970781952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121306.007864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.007893:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970782336:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.007914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.007932:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970782848:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.007952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.007974:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970783360:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.007993:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.008008:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789121306.008014:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970781824:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.008041:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.008063:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970782464:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.008095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.008106:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970782976:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.008123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121306.008147:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782208 00000100:00100000:0.0:1789121306.008151:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782208 00000100:00100000:0.0:1789121306.008182:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782720 00000100:00100000:0.0:1789121306.008185:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782720 00000100:00100000:0.0:1789121306.008199:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782336 00000100:00100000:0.0:1789121306.008201:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782336 00000100:00100000:0.0:1789121306.008219:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121306.008227:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970782208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.008284:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970782208:12345-0@lo:400:kworker.0 Request processed in 56us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121306.008291:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121306.008307:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789121306.008313:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970782720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.008340:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970782720:12345-0@lo:400:kworker.0 Request processed in 27us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121306.008347:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789121306.008358:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789121306.008364:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970782336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008604:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782848 00000100:00100000:3.0:1789121306.008609:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782848 00000100:00100000:3.0:1789121306.008630:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783360 00000100:00100000:3.0:1789121306.008632:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783360 00000100:00100000:3.0:1789121306.008645:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782464 00000100:00100000:3.0:1789121306.008647:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782464 00000100:00100000:3.0:1789121306.008657:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782976 00000100:00100000:3.0:1789121306.008660:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782976 00000100:00100000:3.0:1789121306.008675:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789121306.008681:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008717:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970783232:12345-0@lo:400:kworker.0 Request processed in 36us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.008724:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789121306.008737:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789121306.008742:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970782848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008773:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970782848:12345-0@lo:400:kworker.0 Request processed in 31us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.008779:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789121306.008792:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789121306.008798:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008854:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970783360:12345-0@lo:400:kworker.0 Request processed in 56us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.008860:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789121306.008871:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789121306.008877:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970782464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008903:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970782464:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.008920:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789121306.008932:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121306.008938:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970782976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.008966:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970782976:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.008971:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121306.008988:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782080 00000100:00100000:3.0:1789121306.008991:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782080 00000100:00100000:3.0:1789121306.009011:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970782592 00000100:00100000:3.0:1789121306.009013:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970782592 00000100:00100000:3.0:1789121306.009023:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789121306.009028:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970782080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.009057:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970782080:12345-0@lo:400:kworker.0 Request processed in 29us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.009062:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789121306.009071:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789121306.009076:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970782592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121306.009095:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970782592:12345-0@lo:400:kworker.0 Request processed in 19us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121306.009100:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789121306.009130:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789121306.009134:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121306.009136:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121306.009138:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121306.009203:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781952 00000100:00100000:1.0:1789121306.009208:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781952 00000100:00100000:1.0:1789121306.009237:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789121306.009243:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970781952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789121306.009258:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789121306.009293:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970781952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121306.009299:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000001:00100000:1.0:1789121306.009882:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 82a2cd91-c608-4b81-82c0-46b7dff07711 00000001:00100000:1.0:1789121306.009892:0:24164:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff 00000100:00100000:0.0:1789121306.010126:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970782336:12345-0@lo:400:kworker.0 Request processed in 1761us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121306.010134:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789121306.010169:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970781824 00000100:00100000:0.0:1789121306.010174:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970781824 00000100:00100000:0.0:1789121306.010207:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789121306.010224:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3646:x1876028970781824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.010262:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3646:x1876028970781824:12345-0@lo:400:kworker.0 Request processed in 39us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121306.010268:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789121306.010339:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970781824:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.010355:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970782464:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.010366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970782976:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.010389:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000001:00100000:1.0:1789121306.010731:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82a2cd91-c608-4b81-82c0-46b7dff07711 00000001:00100000:1.0:1789121306.010738:0:24936:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff 00000100:00100000:2.0:1789121306.010994:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789121306.011002:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970783104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121306.011046:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970783104:12345-0@lo:400:kworker.0 Request processed in 46us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121306.011053:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789121306.011986:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789121306.012156:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970781952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121306.012186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970782336:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012198:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970782848:0@lo:400:kworker.0 00010000:00080000:0.0:1789121306.012212:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f1e00 x1876028970783360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121306.012223:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970783360:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012280:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970782080:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012289:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970782592:0@lo:400:kworker.0 00010000:00080000:0.0:1789121306.012300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f0000 x1876028970783104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121306.012309:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970783104:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012320:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970782208:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012346:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970782720:0@lo:400:kworker.0 00000100:00100000:0.0:1789121306.012356:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970783232:0@lo:400:kworker.0 00000001:00100000:2.0:1789121306.012539:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 82a2cd91-c608-4b81-82c0-46b7dff07711 00000001:00100000:2.0:1789121306.012548:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff 00010000:00010000:3.0:1789121306.193913:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789121306.632760:0:26321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789121307.218194:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789121307.743390:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121308.242933:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789121308.570412:0:25758:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82a2cd91-c608-4b81-82c0-46b7dff07711 00000100:00100000:0.0:1789121308.628666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.628731:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.628758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.628781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.628814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.628860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121308.629391:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594496 00000100:00100000:2.0:1789121308.629405:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594496 00000100:00100000:2.0:1789121308.629473:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:2.0:1789121308.629485:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2409:x1876028947594496:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121308.629582:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2409:x1876028947594496:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 99us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121308.629591:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:0.0:1789121308.629919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.629944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.630096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121308.630124:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594624 00000100:00100000:0.0:1789121308.630128:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594624 00000100:00100000:0.0:1789121308.630292:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594752 00000100:00100000:0.0:1789121308.630297:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594752 00000100:00100000:0.0:1789121308.630318:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595136 00000100:00100000:0.0:1789121308.630321:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595136 00000100:00100000:0.0:1789121308.630347:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595264 00000100:00100000:0.0:1789121308.630350:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595264 00000100:00100000:0.0:1789121308.630373:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:0.0:1789121308.630382:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2409:x1876028947594624:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121308.630434:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2409:x1876028947594624:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 53us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121308.630442:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:0.0:1789121308.630456:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789121308.630463:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2409:x1876028947594752:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121308.630499:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2409:x1876028947594752:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 37us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121308.630507:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:0.0:1789121308.630520:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789121308.630527:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2410:x1876028947595136:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121308.630552:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2410:x1876028947595136:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121308.630558:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789121308.630584:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789121308.630591:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595264:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121308.630616:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595264:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121308.630623:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789121308.630650:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947594880 00000100:00100000:0.0:1789121308.630653:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947594880 00000100:00100000:2.0:1789121308.630859:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595392 00000100:00100000:2.0:1789121308.630864:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595392 00000100:00100000:2.0:1789121308.630896:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595008 00000100:00100000:2.0:1789121308.630907:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595008 00000100:00100000:2.0:1789121308.630926:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595520 00000100:00100000:2.0:1789121308.630929:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595520 00000100:00100000:2.0:1789121308.630943:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789121308.630949:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2409:x1876028947594880:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121308.630993:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2409:x1876028947594880:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 44us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121308.630999:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789121308.631012:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789121308.631018:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595392:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121308.631041:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595392:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121308.631047:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789121308.631059:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789121308.631064:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947595008:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121308.631089:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947595008:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121308.631094:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789121308.631105:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789121308.631110:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595520:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121308.631131:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947595520:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121308.631136:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00080000:0.0:1789121308.631783:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789121308.631789:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121308.631803:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121308.631806:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121309.075636:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970783488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121309.075736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121309.075860:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783488 00000100:00100000:3.0:1789121309.075871:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783488 00000100:00100000:3.0:1789121309.075944:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789121309.075956:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970783488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121309.075994:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00080000:0.0:1789121309.079436:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121309.089496:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970783488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13526us (13744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121309.089515:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789121309.089692:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970783488:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789121309.266872:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121309.593861:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970783616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121309.593983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121309.594045:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121309.594054:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970783744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121309.594081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121309.594336:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783616 00000100:00100000:3.0:1789121309.594347:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783616 00000100:00100000:3.0:1789121309.594407:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783744 00000100:00100000:3.0:1789121309.594411:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783744 00000100:00100000:3.0:1789121309.594430:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121309.594439:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970783616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121309.594484:0:23434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789121309.594537:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970783616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121309.594545:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121309.594579:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789121309.594585:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970783744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121309.594602:0:23434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121309.594627:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970783744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 43us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121309.594633:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789121309.595232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970783744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121309.595250:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970783616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121310.098689:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970783872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121310.099882:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121310.100168:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970783872 00000100:00100000:0.0:1789121310.100178:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970783872 00000100:00100000:0.0:1789121310.101952:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789121310.101973:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970783872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121310.102010:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121310.102115:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970783872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121310.102124:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789121310.102206:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970783872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789121310.103773:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789121310.301922:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121310.547706:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1789121310.682076:0:26468:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe70172e30 20000000:00000080:0.0:1789121310.682102:0:26468:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468bc37e400 uarg=0000000000000000 20000000:01000000:0.0:1789121310.682235:0:26468:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789121310.682243:0:26468:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789121310.682251:0:26468:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789121310.683907:0:26469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789121310.684324:0:26468:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789121310.691320:0:26468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789121310.691382:0:26468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691409:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691419:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691427:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691434:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691444:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691452:0:26468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691461:0:26468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691517:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.691536:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 12 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.691554:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784000:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789121310.692389:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.692401:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.692412:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784128:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789121310.692460:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.692469:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.692479:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784256:0@lo:104: 00000100:00100000:3.0:1789121310.692528:0:26468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121310.692578:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784256 00000100:00100000:3.0:1789121310.692586:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784256 00000100:00100000:3.0:1789121310.692651:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789121310.692661:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784256:12345-0@lo:104: 00010000:00010000:3.0:1789121310.692689:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.692746:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121310.692753:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784256:12345-0@lo:104: Request processed in 94us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121310.692761:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789121310.692837:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.692862:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.692871:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784384:0@lo:104: 00000100:00100000:3.0:1789121310.692896:0:26468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121310.692917:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784384 00000100:00100000:3.0:1789121310.692920:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784384 00000100:00100000:3.0:1789121310.692937:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121310.692943:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784384:12345-0@lo:104: 00010000:00010000:3.0:1789121310.692952:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693421:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121310.693431:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693440:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ace00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121310.693445:0:25734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693456:0:25734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121310.693464:0:25734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121310.693471:0:25734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789121310.693510:0:25734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693517:0:25734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121310.693541:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693549:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa9ace00/0xb74d2367a8311148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a831114f expref: -99 pid: 25757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693566:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121310.693567:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121310.693569:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121310.693591:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970784512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121310.693629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121310.693686:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784512 00000100:00100000:2.0:1789121310.693691:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784512 00010000:00010000:2.0:1789121310.693718:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 24 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.693747:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789121310.693755:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3647:x1876028970784512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.693769:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.693805:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 24 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693817:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 24 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.693862:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121310.693890:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3647:x1876028970784512:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.693897:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789121310.693956:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970784512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121310.694082:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121310.694089:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784384:12345-0@lo:104: Request processed in 1146us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121310.694098:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789121310.694121:0:23418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121310.694126:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694134:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121310.694138:0:23418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694145:0:23418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121310.694151:0:23418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121310.694179:0:23418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789121310.694201:0:23418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694206:0:23418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121310.694226:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694233:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e74000/0xb74d2367a8310fce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310fd5 expref: -99 pid: 24935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694243:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121310.694245:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121310.694247:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121310.694273:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694282:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.694292:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784768:0@lo:104: 00000100:00100000:3.0:1789121310.694336:0:26468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121310.694358:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784768 00000100:00100000:3.0:1789121310.694362:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784768 00000100:00100000:3.0:1789121310.694381:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789121310.694387:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784768:12345-0@lo:104: 00010000:00010000:3.0:1789121310.694396:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694436:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121310.694442:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784768:12345-0@lo:104: Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121310.694448:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789121310.694474:0:26468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694482:0:26468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.694491:0:26468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784896:0@lo:104: 00000100:00100000:3.0:1789121310.694511:0:26468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121310.694528:0:23413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784896 00000100:00100000:3.0:1789121310.694531:0:23413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784896 00000100:00100000:3.0:1789121310.694546:0:23413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121310.694551:0:23413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784896:12345-0@lo:104: 00010000:00010000:3.0:1789121310.694558:0:23413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.694599:0:23413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789121310.694604:0:23413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+3:26468:x1876028970784896:12345-0@lo:104: Request processed in 53us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121310.694610:0:23413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121310.694627:0:26468:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06900 going to sleep for 11 seconds 00010000:00010000:3.0:1789121310.694643:0:26468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0c00/0xb74d2367a831114f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8311148 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121310.694653:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784256:0@lo:104: 00000100:00100000:3.0:1789121310.694672:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784384:0@lo:104: 00000100:00100000:3.0:1789121310.694678:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784768:0@lo:104: 00000100:00100000:3.0:1789121310.694684:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784896:0@lo:104: 00010000:00010000:2.0:1789121310.695231:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121310.695237:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695244:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121310.695247:0:23417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695255:0:23417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121310.695275:0:23417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121310.695280:0:23417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789121310.695310:0:23417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695317:0:23417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121310.695327:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695334:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a8310f8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f96 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695345:0:23417:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121310.695348:0:23417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695354:0:23417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121310.695357:0:23417:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695363:0:23417:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121310.695369:0:23417:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121310.695374:0:23417:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789121310.695394:0:23417:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695401:0:23417:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121310.695416:0:23417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695422:0:23417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a8310f81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310f88 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695437:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121310.695438:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121310.695440:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121310.695446:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121310.695457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970785152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121310.695495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121310.695533:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785152 00000100:00100000:2.0:1789121310.695538:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785152 00010000:00010000:2.0:1789121310.695561:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.695584:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121310.695592:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:3646:x1876028970785152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.695603:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.695608:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695617:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695630:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9ac600/0xb74d2367a8310f88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f81 expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.695651:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121310.695895:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:3646:x1876028970785152:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.695904:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121310.696265:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3646:1876028970785152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121310.696583:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970784640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121310.696628:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121310.696721:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121310.696728:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970785024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121310.696753:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121310.698375:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970784640 00000100:00100000:2.0:1789121310.698392:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970784640 00010000:00010000:2.0:1789121310.698446:0:23414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 22 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.698498:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785024 00000100:00100000:2.0:1789121310.698502:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785024 00010000:00010000:2.0:1789121310.698515:0:23414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 23 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.698530:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789121310.698540:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:3644:x1876028970784640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.698559:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.698565:0:23414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.698578:0:23414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.698600:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3400/0xb74d2367a8310fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310fce expref: 23 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.698618:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121310.699621:0:23416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789121310.699636:0:23416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789121310.700094:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:3644:x1876028970784640:12345-0@lo:103:ldlm_bl.0 Request processed in 1550us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.700107:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789121310.700138:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121310.700150:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:3644:x1876028970785024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121310.700281:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970784640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.700338:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.700346:0:23414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 21 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.700358:0:23414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 21 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.700379:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1000/0xb74d2367a8310f96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310f8f expref: 21 pid: 23421 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.700394:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121310.700445:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:3644:x1876028970785024:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.700453:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121310.700512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3644:1876028970785024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121310.705048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121310.705112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121310.705323:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784000:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789121310.705336:0:26468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26468:1876028970784128:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789121310.705388:0:26468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.705508:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595648 00000100:00100000:2.0:1789121310.705516:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595648 00010000:00010000:2.0:1789121310.705560:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 13 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.705590:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595776 00000100:00100000:2.0:1789121310.705592:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595776 00010000:00010000:2.0:1789121310.705601:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 14 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121310.705615:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789121310.705637:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468abbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dee28e-700e-4632-b33d-fd4587623bcd+14:2412:x1876028947595648:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.705656:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.705662:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 14 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705674:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 14 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705704:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa9adc00/0xb74d2367a83112fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f037 expref: 14 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705719:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121310.705797:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468abbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2412:x1876028947595648:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 159us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.705805:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789121310.705882:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789121310.705889:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dee28e-700e-4632-b33d-fd4587623bcd+12:2412:x1876028947595776:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121310.705897:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121310.705902:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705911:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705936:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990a00/0xb74d2367a83112bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7efc7 expref: 12 pid: 23423 timeout: 860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705950:0:23416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705965:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705982:0:23416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705989:0:23416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.705997:0:23416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.706004:0:23416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.706010:0:23416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121310.706015:0:23416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.706024:0:23416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.706037:0:23416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121310.706047:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121310.706075:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b3dee28e-700e-4632-b33d-fd4587623bcd+11:2412:x1876028947595776:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 186us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121310.706081:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00010000:00010000:3.0:1789121310.706675:0:26468:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.706692:0:26468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121310.706699:0:26468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990600/0xb74d2367a831132b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121311.123161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970785408:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121311.123312:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970785920:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123339:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121311.123356:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970786432:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121311.123417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789121311.123424:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970785536:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121311.123496:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970786048:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121311.123538:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970786560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.123560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.123730:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970785280:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.123792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.123859:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970785792:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.123885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.123905:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893845e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970786304:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.123927:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.123943:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970786816:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.123966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.123983:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789121311.123990:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970785664:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.124029:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893844f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.124062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970786688:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121311.124112:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785408 00000100:00100000:2.0:1789121311.124121:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785408 00000100:00100000:2.0:1789121311.124171:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785920 00000100:00100000:2.0:1789121311.124175:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785920 00000100:00100000:2.0:1789121311.124195:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789121311.124206:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970785408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124274:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970785408:12345-0@lo:400:kworker.0 Request processed in 70us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124283:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789121311.124302:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789121311.124308:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970785920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124349:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970785920:12345-0@lo:400:kworker.0 Request processed in 41us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124356:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789121311.124375:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785536 00000100:00100000:2.0:1789121311.124379:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785536 00000100:00100000:2.0:1789121311.124401:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786048 00000100:00100000:2.0:1789121311.124403:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786048 00000100:00100000:2.0:1789121311.124426:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785664 00000100:00100000:2.0:1789121311.124428:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785664 00000100:00100000:2.0:1789121311.124441:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786176 00000100:00100000:2.0:1789121311.124443:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786176 00000100:00100000:2.0:1789121311.124460:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121311.124466:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468baf77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124499:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468baf77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970785536:12345-0@lo:400:kworker.0 Request processed in 33us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124505:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121311.124648:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121311.124655:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970786048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124683:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970786048:12345-0@lo:400:kworker.0 Request processed in 29us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124689:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121311.124699:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121311.124705:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970785664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124738:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970785664:12345-0@lo:400:kworker.0 Request processed in 33us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124744:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121311.124756:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121311.124782:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970786176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124811:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970786176:12345-0@lo:400:kworker.0 Request processed in 43us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124817:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121311.124861:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786432 00000100:00100000:2.0:1789121311.124866:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786432 00000100:00100000:2.0:1789121311.124885:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786560 00000100:00100000:2.0:1789121311.124887:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786560 00000100:00100000:2.0:1789121311.124897:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785792 00000100:00100000:2.0:1789121311.124899:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785792 00000100:00100000:2.0:1789121311.124908:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786304 00000100:00100000:2.0:1789121311.124910:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786304 00000100:00100000:2.0:1789121311.124919:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786816 00000100:00100000:2.0:1789121311.124922:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786816 00000100:00100000:2.0:1789121311.124934:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786688 00000100:00100000:2.0:1789121311.124936:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786688 00000100:00100000:2.0:1789121311.124948:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789121311.124954:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893847c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970786432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.124983:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893847c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970786432:12345-0@lo:400:kworker.0 Request processed in 29us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.124989:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789121311.124998:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121311.125003:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970786560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125027:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970786560:12345-0@lo:400:kworker.0 Request processed in 24us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.125033:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121311.125042:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789121311.125048:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970785792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125083:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970785792:12345-0@lo:400:kworker.0 Request processed in 36us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.125089:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789121311.125100:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121311.125105:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970786304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125127:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970786304:12345-0@lo:400:kworker.0 Request processed in 22us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.125132:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121311.125141:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789121311.125146:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970786816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125167:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970786816:12345-0@lo:400:kworker.0 Request processed in 21us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.125172:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789121311.125181:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789121311.125186:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970786688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125206:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970786688:12345-0@lo:400:kworker.0 Request processed in 20us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121311.125210:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789121311.125255:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970785664:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125266:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893844f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125277:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970786688:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970785792:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125299:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893845e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970786304:0@lo:400:kworker.0 00010000:00080000:2.0:1789121311.125321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893846940 x1876028970786816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121311.125334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970786816:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125380:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970785536:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125394:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970786048:0@lo:400:kworker.0 00010000:00080000:2.0:1789121311.125405:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893847480 x1876028970786560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121311.125415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970786560:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125427:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970785408:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125438:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970785920:0@lo:400:kworker.0 00000100:00100000:2.0:1789121311.125449:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970786432:0@lo:400:kworker.0 00000100:00080000:3.0:1789121311.125610:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789121311.125617:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121311.125620:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121311.125622:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121311.126558:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970785280 00000100:00100000:0.0:1789121311.126566:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970785280 00000100:00100000:0.0:1789121311.126639:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789121311.126649:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:3647:x1876028970785280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121311.126737:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:3647:x1876028970785280:12345-0@lo:400:kworker.0 Request processed in 89us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121311.126759:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789121311.126962:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970787072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121311.127023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121311.127181:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970785280:0@lo:400:kworker.0 00000100:00100000:1.0:1789121311.127271:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121311.127278:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121311.127306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121311.139283:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787072 00000100:00100000:3.0:1789121311.139301:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787072 00000100:00100000:0.0:1789121311.140216:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970786944 00000100:00100000:0.0:1789121311.140227:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970786944 00000100:00100000:0.0:1789121311.140284:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789121311.140298:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970787072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789121311.140346:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121311.140455:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970787072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (13432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121311.140462:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789121311.140480:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789121311.140485:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970786944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121311.140493:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121311.140510:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970786944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (13205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121311.140514:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789121311.141209:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970786944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121311.141234:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970787072:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789121311.314409:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121312.086608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.086873:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947595904 00000100:00100000:2.0:1789121312.086885:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947595904 00000100:00100000:2.0:1789121312.087108:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:2.0:1789121312.087119:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+11:18371:x1876028947595904:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121312.087142:0:23423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.087176:0:23423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74600/0xb74d2367a8311332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f06f expref: -99 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.087223:0:23423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74600/0xb74d2367a8311332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f06f expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.087237:0:23423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74600/0xb74d2367a8311332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f06f expref: 12 pid: 23423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.087267:0:23423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74600, rc 0) 00000100:00100000:2.0:1789121312.087410:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947595904:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 291us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.087418:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:0.0:1789121312.096163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.096422:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596032 00000100:00100000:2.0:1789121312.096437:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596032 00000100:00100000:2.0:1789121312.096566:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:2.0:1789121312.096579:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947596032:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.096805:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947596032:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 229us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.096815:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:3.0:1789121312.102285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.102405:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596160 00000100:00100000:2.0:1789121312.102418:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596160 00000100:00100000:2.0:1789121312.102554:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:2.0:1789121312.102567:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947596160:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.102814:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947596160:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 249us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.102851:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:3.0:1789121312.150210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.150423:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596288 00000100:00100000:2.0:1789121312.150436:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596288 00000100:00100000:2.0:1789121312.150505:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:2.0:1789121312.150518:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+12:18371:x1876028947596288:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121312.150542:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.150566:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e74200/0xb74d2367a8311339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f076 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.150618:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e74200/0xb74d2367a8311339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f076 expref: 13 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.151074:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e74200/0xb74d2367a8311339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f076 expref: 13 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.151087:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74200, rc 0) 00000100:00100000:2.0:1789121312.151220:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18371:x1876028947596288:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 704us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.151240:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:1.0:1789121312.160576:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.161743:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596416 00000100:00100000:2.0:1789121312.161769:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596416 00000100:00100000:2.0:1789121312.162168:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:2.0:1789121312.162182:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18371:x1876028947596416:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.162512:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18371:x1876028947596416:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 331us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.162522:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:3.0:1789121312.182095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.182400:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596544 00000100:00100000:2.0:1789121312.182413:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596544 00000100:00100000:2.0:1789121312.182500:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:2.0:1789121312.182512:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18371:x1876028947596544:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.184156:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b3dee28e-700e-4632-b33d-fd4587623bcd+13:18371:x1876028947596544:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 1633us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.184171:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 152 10000000:01000000:3.0:1789121312.338052:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789121312.338063:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946784a65800 from 19 10000000:01000000:3.0:1789121312.338070:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789121312.338145:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.338160:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.338173:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121312.338214:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.338320:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121312.338390:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06180 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.339097:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787200 00000100:00100000:0.0:1789121312.339108:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787200 00000100:00100000:0.0:1789121312.339191:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789121312.339203:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+20:23426:x1876028970787200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121312.339223:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121312.339245:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9ac800/0xb74d2367a8311347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311340 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.339304:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9ac800/0xb74d2367a8311347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311340 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.339317:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9ac800/0xb74d2367a8311347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311340 expref: 21 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.339329:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ac800, rc 0) 00000100:00100000:0.0:1789121312.339404:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.339412:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789121312.339594:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121312.339616:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311347 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.339625:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8311347 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121312.340301:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.340357:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121312.340455:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06180 going to sleep for 11 seconds 00010000:00010000:3.0:1789121312.340988:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121312.343323:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.343493:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596672 00000100:00100000:3.0:1789121312.343505:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596672 00000100:00100000:3.0:1789121312.343605:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789121312.343618:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:18994:x1876028947596672:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789121312.343645:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121312.343678:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a831134e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f07d expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.343778:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.343796:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.343814:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344284:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344295:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344303:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344421:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8311363 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344430:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8311363 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344462:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8311363 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121312.344500:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789121312.344505:0:23430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789121312.344556:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8311363 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344569:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344576:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344583:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344590:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121312.344596:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344605:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344622:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:3.0:1789121312.344625:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.344631:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344638:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344667:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344674:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344679:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344684:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121312.344687:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344692:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344700:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9468886f6400) 00010000:00010000:3.0:1789121312.344703:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.344706:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344710:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831135c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344753:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a831134e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f07d expref: 8 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344781:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8311363 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f07d expref: 7 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.344798:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468886f6e00) 00010000:00010000:3.0:1789121312.344801:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121312.344803:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991c00, rc 0) 00000100:00100000:3.0:1789121312.345366:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18994:x1876028947596672:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1745us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.345376:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00080000:0.0:1789121312.347182:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121312.348517:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787328 00000100:00100000:2.0:1789121312.348560:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787328 00000100:00100000:2.0:1789121312.348636:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789121312.348649:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.349465:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 815us (9104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.349477:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789121312.351473:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.351573:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.351810:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121312.351883:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787456 00000100:00100000:2.0:1789121312.351902:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787456 00000100:00100000:2.0:1789121312.351977:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789121312.351989:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.352214:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06180 going to sleep for 11 seconds 00000100:00100000:2.0:1789121312.352529:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 541us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.352539:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789121312.353171:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.353271:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789121312.354286:0:26483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789121312.354728:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789121312.354771:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121312.354785:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311347 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.354800:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa990600/0xb74d2367a8311340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311347 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121312.354818:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789121312.354863:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aec000 from 19 10000000:01000000:2.0:1789121312.354867:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121312.354932:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.354959:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.354973:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.355003:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.355081:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121312.355137:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784913480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.355414:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787584 00000100:00100000:0.0:1789121312.355423:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787584 00000100:00100000:0.0:1789121312.355490:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789121312.355502:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+21:23426:x1876028970787584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121312.355518:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121312.355536:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa9adc00/0xb74d2367a8311371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831136a expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.355565:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa9adc00/0xb74d2367a8311371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831136a expref: 22 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.355576:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa9adc00/0xb74d2367a8311371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831136a expref: 22 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.355585:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9adc00, rc 0) 00000100:00100000:0.0:1789121312.355642:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.355664:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789121312.356644:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121312.356681:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311371 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.356693:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8311371 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.356806:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.358278:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121312.358345:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784913480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.358466:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787712 00000100:00100000:0.0:1789121312.358478:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787712 00000100:00100000:0.0:1789121312.358541:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789121312.358552:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789121312.358754:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.358772:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789121312.360565:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.360650:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.361206:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121312.361257:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bb9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.361319:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787840 00000100:00100000:0.0:1789121312.361328:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787840 00000100:00100000:0.0:1789121312.361404:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789121312.361416:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789121312.361586:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.361594:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789121312.361779:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947596800 00000100:00100000:3.0:1789121312.361786:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947596800 00000100:00100000:3.0:1789121312.361864:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789121312.361873:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18994:x1876028947596800:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789121312.361953:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18994:x1876028947596800:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 Request processed in 82us (8786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.361961:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789121312.362314:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789121312.371357:0:26484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789121312.371559:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789121312.371595:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789121312.371611:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311371 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.371653:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e75800/0xb74d2367a831136a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8311371 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121312.371678:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789121312.371681:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946891f07000 from 19 10000000:01000000:1.0:1789121312.371685:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789121312.371737:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.371745:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.372153:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121312.372189:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.372286:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121312.372336:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121312.372424:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970787968 00000100:00100000:2.0:1789121312.372433:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970787968 00000100:00100000:2.0:1789121312.372498:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789121312.372509:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+22:23426:x1876028970787968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121312.372527:0:23421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.372544:0:23421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e75c00/0xb74d2367a831137f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8311378 expref: -99 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.372588:0:23421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e75c00/0xb74d2367a831137f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8311378 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.372599:0:23421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e75c00/0xb74d2367a831137f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8311378 expref: 23 pid: 23421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.372610:0:23421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e75c00, rc 0) 00000100:00100000:2.0:1789121312.372659:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970787968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.372680:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789121312.373190:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970787968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121312.373211:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831137f expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.373222:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831137f expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121312.373305:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.373342:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121312.373380:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121312.373447:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788096 00000100:00100000:2.0:1789121312.373452:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788096 00000100:00100000:2.0:1789121312.373490:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789121312.373499:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970788096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.373639:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970788096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.373647:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789121312.374285:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.374334:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.374395:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121312.374424:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121312.374961:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788224 00000100:00100000:3.0:1789121312.374969:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788224 00000100:00100000:3.0:1789121312.375989:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789121312.376014:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970788224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121312.377595:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970788224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1582us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.377610:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789121312.381290:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789121312.384549:0:26485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000100:00100000:3.0:1789121312.389628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.389749:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597056 00000100:00100000:3.0:1789121312.389782:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597056 00000100:00100000:3.0:1789121312.389903:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789121312.389922:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:18994:x1876028947597056:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789121312.389953:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121312.389990:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8311386 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f084 expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390095:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390113:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390130:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390148:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390156:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390164:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390310:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a831139b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390319:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a831139b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390339:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a831139b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121312.390351:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789121312.390560:0:23431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390568:0:23431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390576:0:23431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390581:0:23431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121312.390586:0:23431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390594:0:23431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390608:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468886f6e00) 00010000:00010000:3.0:1789121312.390612:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.390618:0:23431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390625:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a831138d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390642:0:23431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390648:0:23431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390661:0:23431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390667:0:23431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121312.390670:0:23431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390677:0:23431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390684:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9468886f6400) 00010000:00010000:3.0:1789121312.390687:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.390690:0:23431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.390696:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8311394 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1789121312.391497:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789121312.391546:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789121312.391557:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831137f expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.391569:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e23800/0xb74d2367a8311378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831137f expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121312.391650:0:23426:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789121312.391655:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468c076d800 from 19 10000000:01000000:0.0:1789121312.391658:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789121312.391709:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.391718:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.391728:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121312.391777:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121312.392380:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121312.392448:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784a9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789121312.392596:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788352 00000100:00100000:1.0:1789121312.392605:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788352 00000100:00100000:1.0:1789121312.392795:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789121312.392807:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+23:23426:x1876028970788352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121312.393152:0:23424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121312.393174:0:23424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23a00/0xb74d2367a83113b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83113a9 expref: -99 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.393210:0:23424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23a00/0xb74d2367a83113b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83113a9 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.393221:0:23424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23a00/0xb74d2367a83113b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83113a9 expref: 24 pid: 23424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.393252:0:23424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23a00, rc 0) 00000100:00100000:1.0:1789121312.393329:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970788352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 525us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121312.393338:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:3.0:1789121312.394280:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8311386 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f084 expref: 10 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.394317:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a831139b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f084 expref: 9 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.394328:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468886f6500) 00010000:00010000:3.0:1789121312.394331:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.394335:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991000, rc 0) 00000100:00100000:2.0:1789121312.394873:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:18994:x1876028947597056:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4903us (5212us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789121312.394895:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789121312.397435:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121312.397473:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83113b0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.397489:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83113b0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121312.397619:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789121312.398074:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121312.398191:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946784a9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789121312.400115:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788480 00000100:00100000:1.0:1789121312.400134:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788480 00000100:00100000:1.0:1789121312.400215:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789121312.400226:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970788480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.400469:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970788480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121312.400478:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789121312.400722:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.400859:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121312.400938:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121312.400989:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.401099:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788608 00000100:00100000:0.0:1789121312.401107:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788608 00000100:00100000:0.0:1789121312.401145:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789121312.401153:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970788608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789121312.401296:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:23426:x1876028970788608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.401304:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789121312.402148:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:23426:1876028970788608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121312.402206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.402245:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597184 00000100:00100000:3.0:1789121312.402254:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597184 00000100:00100000:3.0:1789121312.402318:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789121312.402328:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:18994:x1876028947597184:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789121312.402438:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:18994:x1876028947597184:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.402446:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000040:00080000:0.0:1789121312.405459:0:26486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121312.408720:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121312.408782:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121312.408797:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83113b0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.408810:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa9ac600/0xb74d2367a83113a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83113b0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121312.409263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121312.409313:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.409385:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597312 00000100:00100000:0.0:1789121312.409398:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597312 00000100:00100000:0.0:1789121312.409494:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597440 00000100:00100000:0.0:1789121312.409498:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597440 00000100:00100000:0.0:1789121312.409532:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789121312.409544:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:18994:x1876028947597312:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789121312.409625:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789121312.409662:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:19000:x1876028947597440:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789121312.409676:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121312.409704:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a83113b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f08b expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.409789:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.409808:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.409853:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410012:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410032:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410042:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410102:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410109:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410115:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410144:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121312.410149:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410157:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410172:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:0.0:1789121312.410175:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121312.410179:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410185:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a83113be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410201:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410208:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410213:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410217:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9acc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121312.410220:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410226:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410243:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468b9863500) 00010000:00010000:0.0:1789121312.410248:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121312.410252:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410259:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a83113c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410307:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a83113b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f08b expref: 10 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410318:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:0.0:1789121312.410321:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121312.410324:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a83113b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f08b expref: 10 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.410335:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ace00, rc 0) 00000100:00080000:3.0:1789121312.410790:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789121312.412978:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:19000:x1876028947597440:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3310us (3646us total) trans 0 rc 301/301 00000100:00100000:0.0:1789121312.412992:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000004:00080000:0.0:1789121312.414808:0:23431:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5207us 00000100:00100000:0.0:1789121312.426441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.426543:0:23438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597568 00000100:00100000:3.0:1789121312.426560:0:23438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597568 00000100:00100000:3.0:1789121312.426636:0:23438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789121312.426648:0:23438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:19000:x1876028947597568:12345-192.168.202.32@tcp:700:lfs.0 00000100:00100000:3.0:1789121312.426796:0:23438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:19000:x1876028947597568:12345-192.168.202.32@tcp:700:lfs.0 Request processed in 149us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.426817:0:23438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789121312.435152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.435243:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597824 00000100:00100000:2.0:1789121312.435256:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597824 00000100:00100000:2.0:1789121312.435323:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121312.435345:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:19000:x1876028947597824:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:2.0:1789121312.435421:0:23429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121312.435462:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a83112e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eff8 expref: 9 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.435482:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:2.0:1789121312.435488:0:23429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121312.435571:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.435588:0:23429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 5 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.435597:0:23429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.435640:0:23429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 5 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.435667:0:23429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 5 pid: 24965 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.435685:0:23429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23429:1876028970788736:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121312.437013:0:23429:0:(client.c:2715:ptlrpc_set_wait()) set ffff946893bb8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789121312.444385:0:23429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f30c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23429:1876028970788736:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789121312.444430:0:23429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.447345:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:18994:x1876028947597312:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 37778us (38067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.447365:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789121312.455589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.457063:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947597952 00000100:00100000:2.0:1789121312.457106:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947597952 00000100:00080000:3.0:1789121312.457186:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789121312.457200:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 6 pid: 24965 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.457272:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:2.0:1789121312.457284:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2412:x1876028947597952:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121312.457305:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121312.457313:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 6 pid: 24965 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457327:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 6 pid: 24965 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457356:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311324 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f068 expref: 6 pid: 24965 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457375:0:23416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:2.0:1789121312.457381:0:23416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457392:0:23416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457401:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.457436:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789121312.457470:0:23429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.457486:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.457519:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2412:x1876028947597952:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 236us (1939us total) trans 0 rc 0/0 00010000:00010000:3.0:1789121312.457537:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.457545:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:3.0:1789121312.457568:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.457582:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460665:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460686:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460698:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789121312.460714:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a31a2169 reply state 000000003b9c9ef8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460734:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460742:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:3.0:1789121312.460745:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789121312.460749:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789121312.460766:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789121312.460776:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460783:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460791:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460797:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121312.460801:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.460810:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.461716:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9863600) 00010000:00010000:3.0:1789121312.461723:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121312.461730:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.461738:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789121312.461789:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a31a2169 reply state 000000003b9c9ef8 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.461801:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.461808:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468886f6400) 00010000:00010000:3.0:1789121312.461811:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789121312.461813:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789121312.462331:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+10:19000:x1876028947597824:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 26981us (27188us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789121312.462341:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789121312.590326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121312.590542:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598080 00000100:00100000:1.0:1789121312.590554:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598080 00000100:00100000:1.0:1789121312.590621:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789121312.590632:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+10:19008:x1876028947598080:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:1.0:1789121312.590803:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121312.591106:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a83113e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f092 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591189:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83113e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591221:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83113e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591234:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83113e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121312.591289:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789121312.591293:0:24965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789121312.591336:0:24965:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83113e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591369:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a83113e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f092 expref: 12 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591387:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83113e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f092 expref: 11 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121312.591396:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:1.0:1789121312.591399:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121312.591734:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22800, rc 0) 00000100:00100000:1.0:1789121312.592366:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+11:19008:x1876028947598080:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 1731us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121312.592379:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000040:00080000:2.0:1789121312.595267:0:24185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121312.633462:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.633642:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598208 00000100:00100000:2.0:1789121312.633659:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598208 00000100:00100000:2.0:1789121312.633730:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121312.633743:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893844f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:19009:x1876028947598208:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121312.633777:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.633803:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f099 expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.633919:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83113f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.633941:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83113f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.634174:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83113f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121312.634230:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121312.634235:0:23431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121312.634259:0:23431:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83113f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.634290:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e74000/0xb74d2367a83113ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f099 expref: 7 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.634309:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83113f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f099 expref: 6 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.634335:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121312.634338:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121312.634342:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:2.0:1789121312.634594:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893844f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+6:19009:x1876028947598208:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 853us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.634602:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789121312.653292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.660581:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598336 00000100:00100000:3.0:1789121312.660596:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598336 00000100:00100000:2.0:1789121312.666285:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789121312.666302:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+6:19009:x1876028947598336:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121312.666327:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.666350:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a83113fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0a0 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666608:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666625:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666638:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666649:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666658:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666664:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666770:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666780:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666787:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121312.666854:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121312.666858:0:23430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121312.666884:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666897:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666904:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666911:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666917:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.666921:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666928:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.666941:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121312.668105:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.668121:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668131:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8311404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668154:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668161:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668170:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668176:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.668180:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668187:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668199:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468886f6400) 00010000:00010000:2.0:1789121312.668202:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.668205:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668211:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831140b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668254:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a83113fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0a0 expref: 8 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668291:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0a0 expref: 7 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.668300:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:2.0:1789121312.668302:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121312.668305:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:2.0:1789121312.668575:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+7:19009:x1876028947598336:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2275us (15292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.668586:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789121312.681645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.686570:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598464 00000100:00100000:3.0:1789121312.686587:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598464 00000100:00080000:0.0:1789121312.686851:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121312.687070:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789121312.687081:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:19009:x1876028947598464:12345-192.168.202.32@tcp:900:lfs.0 00000100:00100000:3.0:1789121312.687322:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:19009:x1876028947598464:12345-192.168.202.32@tcp:900:lfs.0 Request processed in 241us (5684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.687330:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789121312.709726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.709854:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598720 00000100:00100000:3.0:1789121312.709864:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598720 00000100:00100000:3.0:1789121312.709934:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:3.0:1789121312.709944:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+7:19009:x1876028947598720:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789121312.709966:0:23429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121312.709987:0:23429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8311419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0a7 expref: -99 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121312.710123:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789121312.710234:0:23429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8311419 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0a7 expref: 9 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.710248:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:3.0:1789121312.710516:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789121312.710525:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8311419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0a7 expref: 9 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121312.710541:0:23429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991800, rc 0) 00000100:00100000:0.0:1789121312.710670:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+8:19009:x1876028947598720:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 726us (953us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789121312.710678:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:1.0:1789121312.723592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.723862:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947598976 00000100:00100000:0.0:1789121312.723873:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947598976 00000100:00100000:0.0:1789121312.723949:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:0.0:1789121312.723960:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+8:19009:x1876028947598976:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:0.0:1789121312.724020:0:24965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121312.724054:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311412 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0a0 expref: 8 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.724073:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121312.724078:0:24965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789121312.724105:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.724118:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.724129:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789121312.724682:0:24965:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028c31d41 reply state 000000006fab6f56 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.724696:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.724703:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121312.724705:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789121312.724721:0:24965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789121312.724730:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789121312.724862:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+9:19009:x1876028947598976:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 865us (1240us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789121312.724871:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:3.0:1789121312.727132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.727348:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947599232 00000100:00100000:0.0:1789121312.727357:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947599232 00000100:00100000:0.0:1789121312.727422:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789121312.727431:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+9:19009:x1876028947599232:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121312.727645:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+10:19009:x1876028947599232:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 214us (521us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789121312.727654:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789121312.732113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.732212:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947599488 00000100:00100000:2.0:1789121312.732223:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947599488 00000100:00100000:2.0:1789121312.732309:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789121312.732321:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+10:19009:x1876028947599488:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121312.732347:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.732370:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831142e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0ae expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732746:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732772:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732785:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732798:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732818:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.732855:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121312.733137:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121312.733222:0:23431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733230:0:23431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733235:0:23431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733241:0:23431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.733245:0:23431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733263:0:23431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733275:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121312.733278:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.733283:0:23431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733289:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733312:0:23431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733318:0:23431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733325:0:23431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733329:0:23431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.733332:0:23431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733337:0:23431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733345:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468886f6400) 00010000:00010000:2.0:1789121312.733347:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.733350:0:23431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733355:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831143c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.733392:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831142e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ae expref: 12 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.734069:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121312.734073:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121312.734089:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831142e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ae expref: 12 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.734103:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2e00, rc 0) 00000100:00100000:2.0:1789121312.734315:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+11:19009:x1876028947599488:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1991us (2207us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789121312.734324:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:1.0:1789121312.746881:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.747153:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947599616 00000100:00100000:2.0:1789121312.747163:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947599616 00000100:00100000:2.0:1789121312.747226:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789121312.747238:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+11:19009:x1876028947599616:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121312.747264:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.747287:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831144a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0b5 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747388:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747523:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747536:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121312.747566:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121312.747571:0:23430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121312.747593:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747624:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831144a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 13 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747655:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 12 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.747666:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:2.0:1789121312.747670:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121312.747673:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2400, rc 0) 00000100:00100000:2.0:1789121312.747738:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+12:19009:x1876028947599616:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 502us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.747746:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789121312.755302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.755497:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947599744 00000100:00100000:0.0:1789121312.755509:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947599744 00000100:00100000:0.0:1789121312.755577:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789121312.755590:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+12:19009:x1876028947599744:12345-192.168.202.32@tcp:37:lfs.0 00000100:00100000:0.0:1789121312.763122:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+12:19009:x1876028947599744:12345-192.168.202.32@tcp:37:lfs.0 Request processed in 7521us (7818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.763137:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:1.0:1789121312.782319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.782522:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600000 00000100:00100000:3.0:1789121312.782532:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600000 00000100:00100000:3.0:1789121312.782602:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789121312.782613:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+12:19009:x1876028947600000:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789121312.784556:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+13:19009:x1876028947600000:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1934us (2236us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789121312.784571:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000040:00080000:2.0:1789121312.850810:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789121312.875610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121312.875763:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600128 00000100:00100000:2.0:1789121312.875773:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600128 00000100:00100000:2.0:1789121312.875867:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:2.0:1789121312.875878:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+11:19015:x1876028947600128:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789121312.875901:0:23429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121312.875924:0:23429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0bc expref: -99 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.875999:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876016:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876029:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876073:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876082:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876088:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876174:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831146d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876183:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831146d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876189:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831146d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121312.876224:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121312.876228:0:23429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121312.876281:0:23429:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831146d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876295:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876302:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876308:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876552:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.876556:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876563:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876576:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121312.876578:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.876583:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876589:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831145f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876601:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876607:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876613:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876617:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121312.876619:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876624:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876642:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468886f6400) 00010000:00010000:2.0:1789121312.876644:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121312.876647:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876653:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311466 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876681:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0bc expref: 13 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876695:0:23429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2e00/0xb74d2367a831146d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0bc expref: 12 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.876701:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:2.0:1789121312.876703:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789121312.876706:0:23429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2e00, rc 0) 00000100:00100000:2.0:1789121312.876780:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+12:19015:x1876028947600128:12345-192.168.202.32@tcp:101:bash.0 Request processed in 904us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.876789:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789121312.884172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.887045:0:23440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600256 00000100:00100000:3.0:1789121312.887063:0:23440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600256 00000100:00100000:3.0:1789121312.887183:0:23440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121312.887196:0:23440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:19015:x1876028947600256:12345-192.168.202.32@tcp:900:bash.0 00000100:00100000:3.0:1789121312.887310:0:23440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:19015:x1876028947600256:12345-192.168.202.32@tcp:900:bash.0 Request processed in 116us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121312.887319:0:23440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:1.0:1789121312.896279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.900068:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600512 00000100:00100000:0.0:1789121312.900085:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600512 00000100:00100000:0.0:1789121312.900169:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789121312.900180:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+12:19015:x1876028947600512:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789121312.900204:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121312.900229:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8311474 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0c3 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.900378:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.900397:0:24965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 12 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.900407:0:24965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.900448:0:24965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 12 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.900463:0:24965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 12 pid: 23430 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121312.900478:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970788864:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121312.900626:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121312.910143:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970788864:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121312.910177:0:24965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121312.916649:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.918874:0:26470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600640 00000100:00100000:3.0:1789121312.918966:0:26470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600640 00010000:00010000:2.0:1789121312.920877:0:26470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 13 pid: 23430 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121312.921078:0:26470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789121312.921091:0:26470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+13:2411:x1876028947600640:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121312.921107:0:26470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121312.921127:0:26470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 13 pid: 23430 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921140:0:26470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 13 pid: 23430 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921163:0:26470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311451 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0b5 expref: 13 pid: 23430 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921179:0:26470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:2.0:1789121312.921184:0:26470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921193:0:26470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921200:0:26470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121312.921355:0:26470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121312.921424:0:26470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a2cd91-c608-4b81-82c0-46b7dff07711+12:2411:x1876028947600640:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 338us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121312.921432:0:26470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00010000:00010000:0.0:1789121312.924809:0:24965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.925215:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.925303:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.925335:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.925348:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927277:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927298:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927311:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121312.927325:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789121312.927358:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927365:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927372:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927378:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121312.927383:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927391:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927422:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121312.927425:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121312.927430:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927437:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a831147b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789121312.927452:0:24965:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007fdec509 reply state 000000006989422d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927465:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927471:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9468b9863500) 00010000:00010000:0.0:1789121312.927473:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789121312.927476:0:24965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789121312.927518:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8311474 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 15 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927533:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 14 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.927539:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121312.927541:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789121312.927543:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1000, rc 0) 00000100:00100000:0.0:1789121312.927628:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:19015:x1876028947600512:12345-192.168.202.32@tcp:101:bash.0 Request processed in 27448us (31358us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789121312.927637:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:1.0:1789121312.950442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121312.950686:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947600768 00000100:00100000:0.0:1789121312.950697:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947600768 00000100:00100000:0.0:1789121312.950789:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:0.0:1789121312.950799:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:19015:x1876028947600768:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789121312.950855:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121312.950877:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311497 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0ca expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.950969:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.950984:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.950996:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121312.951048:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789121312.951053:0:23431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789121312.951075:0:23431:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.951087:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.951113:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311497 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ca expref: 17 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.951132:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ca expref: 16 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121312.951161:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121312.951164:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121312.951168:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:0.0:1789121312.951222:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+16:19015:x1876028947600768:12345-192.168.202.32@tcp:101:bash.0 Request processed in 424us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121312.951230:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789121312.960306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121312.960395:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947601024 00000100:00100000:3.0:1789121312.960407:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947601024 00000100:00100000:3.0:1789121312.960471:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789121312.960482:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+16:19015:x1876028947601024:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789121312.960801:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+17:19015:x1876028947601024:12345-192.168.202.32@tcp:35:bash.0 Request processed in 319us (504us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789121312.960809:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789121313.124550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121313.126517:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947601280 00000100:00100000:2.0:1789121313.126531:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947601280 00000100:00100000:2.0:1789121313.126671:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789121313.126683:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+17:19025:x1876028947601280:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121313.126710:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121313.126746:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a83114a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0d1 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121313.126896:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121313.126998:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a83114a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0d1 expref: 19 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121313.127014:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121313.127017:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121313.127022:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a83114a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0d1 expref: 19 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121313.127036:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2400, rc 0) 00000100:00100000:2.0:1789121313.127155:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+18:19025:x1876028947601280:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 474us (2615us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789121313.127162:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:1.0:1789121313.133570:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121313.133651:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947601536 00000100:00100000:3.0:1789121313.133661:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947601536 00000100:00100000:3.0:1789121313.133717:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789121313.133727:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+18:19025:x1876028947601536:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789121313.133988:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19025:x1876028947601536:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 261us (425us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1789121313.133996:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789121313.199242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.199500:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947601792 00000100:00100000:0.0:1789121313.199513:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947601792 00000100:00100000:0.0:1789121313.199584:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:0.0:1789121313.199594:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19028:x1876028947601792:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789121313.199618:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121313.199638:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114b3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0d8 expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.200009:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0200/0xb74d2367a83114ba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.200028:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0200/0xb74d2367a83114ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.200042:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0200/0xb74d2367a83114ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121313.200058:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789121313.200174:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114b3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0d8 expref: 22 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.200213:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0200/0xb74d2367a83114ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0d8 expref: 21 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.200621:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.200625:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121313.200628:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0200, rc 0) 00000100:00100000:0.0:1789121313.202333:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19028:x1876028947601792:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2729us (3089us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789121313.202345:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:2.0:1789121313.210980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.211107:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947601920 00000100:00100000:0.0:1789121313.211117:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947601920 00000100:00100000:0.0:1789121313.211177:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789121313.211190:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19028:x1876028947601920:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789121313.211269:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211286:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211298:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211333:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211341:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211365:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211372:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121313.211377:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211385:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211397:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.211400:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789121313.211405:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.211412:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114c8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121313.211490:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19028:x1876028947601920:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 301us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121313.211497:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:1.0:1789121313.214592:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.214670:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602048 00000100:00100000:0.0:1789121313.214679:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602048 00000100:00100000:0.0:1789121313.214743:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789121313.214763:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:2412:x1876028947602048:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121313.214778:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121313.214806:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0200/0xb74d2367a83114ba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0d8 expref: 21 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.214875:0:23414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.214880:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121313.214944:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+20:2412:x1876028947602048:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 191us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121313.214953:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789121313.218581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121313.218663:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602304 00000100:00100000:3.0:1789121313.218675:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602304 00000100:00100000:3.0:1789121313.218730:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121313.218740:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+20:19028:x1876028947602304:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789121313.219129:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19028:x1876028947602304:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 388us (557us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789121313.219138:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00010000:00010000:2.0:1789121313.362250:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121313.742174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.742218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121313.742353:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602688 00000100:00100000:2.0:1789121313.742364:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602688 00000100:00100000:2.0:1789121313.742439:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789121313.742451:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947602688:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121313.742533:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947602688:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121313.742540:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121313.742931:0:23423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602432 00000100:00100000:0.0:1789121313.742937:0:23423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602432 00000100:00100000:0.0:1789121313.742980:0:23423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:0.0:1789121313.742989:0:23423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2410:x1876028947602432:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121313.743026:0:23423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2410:x1876028947602432:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 40us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121313.743033:0:23423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:1.0:1789121313.743288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.743329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.743359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.743393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121313.743488:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602944 00000100:00100000:2.0:1789121313.743493:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602944 00000100:00100000:2.0:1789121313.743527:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602560 00000100:00100000:2.0:1789121313.743539:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602560 00000100:00100000:2.0:1789121313.743557:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947603072 00000100:00100000:2.0:1789121313.743559:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947603072 00000100:00100000:2.0:1789121313.743573:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789121313.743579:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947602944:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121313.743616:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947602944:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 37us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121313.743622:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789121313.743634:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789121313.743639:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947602560:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121313.743662:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947602560:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121313.743669:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789121313.743680:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789121313.743685:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947603072:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121313.743704:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947603072:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 19us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121313.743710:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789121313.743727:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947602816 00000100:00100000:2.0:1789121313.743730:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947602816 00000100:00100000:2.0:1789121313.743767:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789121313.743774:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947602816:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121313.743803:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947602816:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121313.743809:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00080000:3.0:1789121313.744237:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121313.744242:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121313.754581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.755981:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947603328 00000100:00100000:1.0:1789121313.755992:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947603328 00000100:00100000:1.0:1789121313.756062:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:1.0:1789121313.756071:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19059:x1876028947603328:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789121313.756096:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121313.756117:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83114cf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0df expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.756248:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.756262:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.756286:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121313.756300:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789121313.756428:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83114cf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0df expref: 24 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.756447:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0df expref: 23 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.756456:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121313.756459:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789121313.756462:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23000, rc 0) 00000100:00100000:1.0:1789121313.756538:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+23:19059:x1876028947603328:12345-192.168.202.32@tcp:101:cat.0 Request processed in 467us (1966us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1789121313.756545:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:2.0:1789121313.775042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121313.775103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.775206:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947603712 00000100:00100000:0.0:1789121313.775217:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947603712 00000100:00100000:0.0:1789121313.775280:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789121313.775291:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+23:19059:x1876028947603712:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:0.0:1789121313.775614:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+24:19059:x1876028947603712:12345-192.168.202.32@tcp:35:cat.0 Request processed in 323us (509us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789121313.775623:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:1.0:1789121313.776461:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947603456 00000100:00100000:1.0:1789121313.776480:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947603456 00000100:00100000:1.0:1789121313.776534:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789121313.776543:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+24:2411:x1876028947603456:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121313.776556:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121313.776581:0:23415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0df expref: 24 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.776599:0:23415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121313.776605:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121313.776660:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+23:2411:x1876028947603456:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 117us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121313.776669:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:2.0:1789121313.883124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.883245:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947603968 00000100:00100000:0.0:1789121313.883257:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947603968 00000100:00100000:0.0:1789121313.883338:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789121313.883349:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+23:19065:x1876028947603968:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:0.0:1789121313.883394:0:23429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121313.883417:0:23429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114e4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0e6 expref: -99 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.883536:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a83114eb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.883551:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a83114eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.883564:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a83114eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121313.883575:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789121313.883719:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a83114e4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0e6 expref: 26 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.883737:0:23429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a83114eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0e6 expref: 25 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.883755:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.883758:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121313.883761:0:23429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0800, rc 0) 00000100:00100000:0.0:1789121313.883880:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19065:x1876028947603968:12345-192.168.202.32@tcp:101:dd.0 Request processed in 532us (767us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1789121313.883887:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:3.0:1789121313.888226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121313.888272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121313.888378:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947604096 00000100:00100000:1.0:1789121313.888388:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947604096 00000100:00100000:1.0:1789121313.888454:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:1.0:1789121313.888464:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19065:x1876028947604096:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789121313.888493:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121313.888515:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114f9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0ed expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888551:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888564:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888574:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888700:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83114f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 27 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888717:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 26 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121313.888724:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121313.888727:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789121313.888730:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23e00, rc 0) 00000100:00100000:1.0:1789121313.888815:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+26:19065:x1876028947604096:12345-192.168.202.32@tcp:101:dd.0 Request processed in 352us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121313.888855:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:0.0:1789121313.889202:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947604224 00000100:00100000:0.0:1789121313.889208:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947604224 00000100:00100000:0.0:1789121313.889256:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789121313.889271:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+26:2410:x1876028947604224:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121313.889282:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121313.889299:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a83114eb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0e6 expref: 26 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.889310:0:23414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.889312:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121313.889339:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:2410:x1876028947604224:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 70us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121313.889345:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:3.0:1789121313.894381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.894716:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947604480 00000100:00100000:0.0:1789121313.894726:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947604480 00000100:00100000:0.0:1789121313.895180:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789121313.895191:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19065:x1876028947604480:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:0.0:1789121313.895254:0:23429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121313.895282:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831149e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ca expref: 25 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.895300:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.895305:0:23429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789121313.895484:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.895498:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.895507:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789121313.895564:0:23429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1789121313.895584:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f8aa4e3 reply state 000000003f9f5f53 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.895595:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121313.895600:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121313.895602:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789121313.895605:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789121313.895710:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+27:19065:x1876028947604480:12345-192.168.202.32@tcp:36:dd.0 Request processed in 521us (1338us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789121313.895717:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000020:00080000:0.0:1789121313.895722:0:23429:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789121313.962566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121313.963110:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947604736 00000100:00100000:0.0:1789121313.963121:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947604736 00000100:00100000:0.0:1789121313.963193:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789121313.963203:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+27:19065:x1876028947604736:12345-192.168.202.32@tcp:35:dd.0 00000100:00100000:0.0:1789121313.963437:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+28:19065:x1876028947604736:12345-192.168.202.32@tcp:35:dd.0 Request processed in 235us (881us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1789121313.963445:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789121314.197158:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121314.197183:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970788992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121314.197260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121314.197381:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970788992 00000100:00100000:1.0:1789121314.197390:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970788992 00000100:00100000:1.0:1789121314.197465:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789121314.197475:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970788992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789121314.197505:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:1.0:1789121314.197546:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970788992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121314.197553:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789121314.198444:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121314.198489:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970788992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121314.260424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121314.260559:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947604864 00000100:00100000:0.0:1789121314.260584:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947604864 00000100:00100000:0.0:1789121314.260712:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789121314.260724:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+28:19079:x1876028947604864:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:0.0:1789121314.260987:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121314.261011:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831150e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0f4 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261083:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261098:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261110:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261121:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261127:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261134:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261287:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261295:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261301:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121314.261348:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789121314.261353:0:24965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789121314.261389:0:24965:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261400:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261408:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261414:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261420:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261425:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121314.261429:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261435:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261446:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121314.261448:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121314.261453:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261458:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8311515 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261480:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261485:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261489:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261494:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121314.261496:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261502:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261508:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9468b9863500) 00010000:00010000:0.0:1789121314.261510:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121314.261512:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261517:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a831151c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261539:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831150e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0f4 expref: 30 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261550:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0f4 expref: 29 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.261565:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121314.261567:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121314.261569:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0600, rc 0) 00000100:00100000:0.0:1789121314.261682:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+29:19079:x1876028947604864:12345-192.168.202.32@tcp:101:stat.0 Request processed in 961us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121314.261690:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00080000:3.0:1789121314.266071:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121314.359454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121314.359559:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947605120 00000100:00100000:2.0:1789121314.359570:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947605120 00000100:00100000:2.0:1789121314.359636:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789121314.359647:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+29:19085:x1876028947605120:12345-192.168.202.32@tcp:36:truncate.0 00010000:00010000:2.0:1789121314.359730:0:23431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121314.359779:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a8311523 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0f4 expref: 29 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.359798:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121314.359803:0:23431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121314.360200:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.360214:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.360225:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789121314.360269:0:23431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:2.0:1789121314.360293:0:23431:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000309f59e8 reply state 0000000078c09bbb transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.360305:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.360311:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121314.360322:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789121314.360326:0:23431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789121314.360511:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+31:19085:x1876028947605120:12345-192.168.202.32@tcp:36:truncate.0 Request processed in 865us (1067us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1789121314.360519:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000020:00080000:2.0:1789121314.360525:0:23431:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789121314.386584:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121314.639517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121314.639676:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947605248 00000100:00100000:2.0:1789121314.639687:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947605248 00000100:00100000:2.0:1789121314.639806:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789121314.639818:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+31:19099:x1876028947605248:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:2.0:1789121314.639884:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121314.639908:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311531 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f0fb expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.639986:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640002:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640015:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640027:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640035:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640041:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640143:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640152:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640158:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121314.640200:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789121314.640206:0:23430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121314.640228:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640240:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640605:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640613:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640620:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640626:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121314.640630:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640645:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640673:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:2.0:1789121314.640676:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121314.640682:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640689:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8311538 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640703:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640710:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640715:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640720:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121314.640723:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640728:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640744:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9468b9863500) 00010000:00010000:2.0:1789121314.640747:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121314.640750:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640756:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831153f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.640807:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8311531 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 33 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.641048:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 32 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.641057:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121314.641059:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789121314.641062:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:2.0:1789121314.641279:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+32:19099:x1876028947605248:12345-192.168.202.32@tcp:101:stat.0 Request processed in 1463us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121314.641288:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:1.0:1789121314.706213:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121314.706223:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121314.706238:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970789120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121314.706238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970789248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121314.715046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121314.715242:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970789120 00000100:00100000:2.0:1789121314.715253:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970789120 00000100:00100000:2.0:1789121314.715326:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789121314.715337:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970789120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121314.715382:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789121314.715471:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970789120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121314.715479:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789121314.715864:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970789120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121314.720303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121314.720485:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970789248 00000100:00100000:2.0:1789121314.720496:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970789248 00000100:00100000:2.0:1789121314.720567:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789121314.720578:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970789248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121314.720618:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121314.720688:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970789248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121314.720710:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789121314.721411:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970789248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121314.823644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121314.824024:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947605504 00000100:00100000:2.0:1789121314.824035:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947605504 00000100:00100000:2.0:1789121314.824105:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789121314.824117:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+32:19109:x1876028947605504:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121314.824140:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121314.824162:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831154d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f102 expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121314.824277:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121314.824386:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831154d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f102 expref: 34 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.824401:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:2.0:1789121314.824405:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121314.824410:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831154d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f102 expref: 34 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.824424:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:2.0:1789121314.824638:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+33:19109:x1876028947605504:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 521us (1002us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1789121314.824657:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:1.0:1789121314.830172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121314.830270:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947605760 00000100:00100000:0.0:1789121314.830283:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947605760 00000100:00100000:0.0:1789121314.830347:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121314.830357:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+33:19109:x1876028947605760:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121314.830603:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+34:19109:x1876028947605760:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 246us (440us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1789121314.830611:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789121314.938686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121314.938798:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606016 00000100:00100000:0.0:1789121314.938808:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606016 00000100:00100000:0.0:1789121314.938928:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:0.0:1789121314.938938:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+34:19115:x1876028947606016:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789121314.938965:0:24965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121314.938987:0:24965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831155b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f109 expref: -99 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939110:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939135:0:24965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939144:0:24965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 35 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939151:0:24965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939186:0:24965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 35 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939200:0:24965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 35 pid: 23430 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121314.939219:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970789376:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121314.939315:0:24965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.939324:0:24965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121314.939332:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970789504:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121314.939354:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121314.952702:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970789376:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121314.952716:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970789504:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121314.952767:0:24965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121314.955411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121314.955509:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121314.955755:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606144 00000100:00100000:3.0:1789121314.955766:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606144 00010000:00010000:3.0:1789121314.955867:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 36 pid: 23430 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121314.955918:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606272 00000100:00100000:3.0:1789121314.955922:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606272 00010000:00010000:3.0:1789121314.955935:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 37 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121314.955960:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789121314.955971:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468abbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:2411:x1876028947606144:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121314.955987:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121314.955994:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 37 pid: 23430 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956006:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 37 pid: 23430 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956031:0:23415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8311546 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0fb expref: 37 pid: 23430 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956061:0:23415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:3.0:1789121314.956067:0:23415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956076:0:23415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956083:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121314.956143:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468abbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+36:2411:x1876028947606144:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 173us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121314.956152:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789121314.956206:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:3.0:1789121314.956214:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+35:2410:x1876028947606272:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121314.956222:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121314.956228:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956239:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956252:0:23415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8311489 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0c3 expref: 35 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956262:0:23415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:3.0:1789121314.956266:0:23415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956284:0:23415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956293:0:23415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.956317:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121314.956336:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+34:2410:x1876028947606272:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 123us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121314.956343:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00010000:00010000:0.0:1789121314.956771:0:24965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.956780:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121314.956801:0:24965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1789121314.957005:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a831155b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 35 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.957024:0:24965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 34 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121314.957033:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121314.957036:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789121314.957039:0:24965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:0.0:1789121314.957080:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+34:19115:x1876028947606016:12345-192.168.202.32@tcp:101:bash.0 Request processed in 18144us (18403us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1789121314.957088:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:1.0:1789121314.960577:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121314.964091:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606528 00000100:00100000:3.0:1789121314.964107:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606528 00000100:00100000:3.0:1789121314.964333:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:3.0:1789121314.964344:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+34:19115:x1876028947606528:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789121314.964581:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.964600:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.964612:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789121314.964673:0:23429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:3.0:1789121314.964695:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ec8f4816 reply state 00000000d0cd9715 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.964711:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121314.964747:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:3.0:1789121314.964750:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789121314.964755:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789121314.965022:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19115:x1876028947606528:12345-192.168.202.32@tcp:36:bash.0 Request processed in 678us (4454us total) trans 12884901914 rc 0/0 00000100:00100000:3.0:1789121314.965030:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000020:00080000:3.0:1789121314.965036:0:23429:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789121314.969114:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121314.969207:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606656 00000100:00100000:1.0:1789121314.969218:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606656 00000100:00100000:1.0:1789121314.969295:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:1.0:1789121314.969306:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19115:x1876028947606656:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789121314.969331:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121314.969372:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a8311577 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f110 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.969435:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a8311577 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f110 expref: 38 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.969449:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a8311577 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f110 expref: 38 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.969467:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121314.969471:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789121314.969476:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23c00, rc 0) 00000100:00100000:1.0:1789121314.969615:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19115:x1876028947606656:12345-192.168.202.32@tcp:101:bash.0 Request processed in 309us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121314.969623:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:1.0:1789121314.985729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121314.985950:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606784 00000100:00100000:2.0:1789121314.985961:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606784 00000100:00100000:2.0:1789121314.986030:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789121314.986042:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19115:x1876028947606784:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789121314.986080:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121314.986108:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831157e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f117 expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.986216:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.986232:0:23431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 39 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.986241:0:23431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.986296:0:23431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 39 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.986311:0:23431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 39 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121314.986325:0:23431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23431:1876028970789632:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121314.986430:0:23431:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121314.992880:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121314.994232:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947606912 00000100:00100000:1.0:1789121314.994255:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947606912 00010000:00010000:1.0:1789121314.994312:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 40 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121314.994362:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789121314.994374:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:2411:x1876028947606912:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121314.994392:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121314.994398:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 40 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.994410:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 40 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.994454:0:23415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121314.994459:0:23415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.994469:0:23415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.994477:0:23415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121314.994501:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121314.994576:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:2411:x1876028947606912:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 203us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121314.994585:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00010000:00010000:2.0:1789121314.994872:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a8311562 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f109 expref: 39 pid: 24965 timeout: 865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121314.994905:0:23431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23431:1876028970789632:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121314.994931:0:23431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.994953:0:23431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.994959:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121314.995021:0:23431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789121314.995027:0:23431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121314.995049:0:23431:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.995084:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831157e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f117 expref: 39 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.995098:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f117 expref: 38 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121314.995106:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121314.995109:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789121314.995112:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:2.0:1789121314.995143:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19115:x1876028947606784:12345-192.168.202.32@tcp:101:bash.0 Request processed in 9104us (9423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121314.995151:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:1.0:1789121315.005740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.005858:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607168 00000100:00100000:0.0:1789121315.005869:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607168 00000100:00100000:0.0:1789121315.005950:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789121315.005962:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19115:x1876028947607168:12345-192.168.202.32@tcp:103:bash.0 00010000:00010000:0.0:1789121315.005981:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789121315.006011:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a8311577 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f110 expref: 38 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.006052:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8311585 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f117 expref: 37 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.006063:0:23414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121315.006068:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121315.006133:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+36:19115:x1876028947607168:12345-192.168.202.32@tcp:103:bash.0 Request processed in 173us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121315.006141:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789121315.008980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121315.009127:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607296 00000100:00100000:2.0:1789121315.009139:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607296 00000100:00100000:2.0:1789121315.009206:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789121315.009217:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+36:19115:x1876028947607296:12345-192.168.202.32@tcp:58:bash.0 00010000:00010000:2.0:1789121315.009337:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.009372:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.009384:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121315.010595:0:24965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121315.010628:0:24965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1789121315.011509:0:24965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1789121315.011636:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+36:19115:x1876028947607296:12345-192.168.202.32@tcp:58:bash.0 Request processed in 2413us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121315.011650:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:3.0:1789121315.021955:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.022100:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607424 00000100:00100000:0.0:1789121315.022110:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607424 00000100:00100000:0.0:1789121315.022190:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:0.0:1789121315.022200:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+36:19115:x1876028947607424:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789121315.022221:0:23429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121315.022241:0:23429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f11e expref: -99 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022310:0:23429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022321:0:23429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 37 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022341:0:23429:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022354:0:23429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 37 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022388:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121315.022391:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789121315.022397:0:23429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 37 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.022405:0:23429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:0.0:1789121315.022474:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19115:x1876028947607424:12345-192.168.202.32@tcp:101:bash.0 Request processed in 275us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121315.022483:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:1.0:1789121315.220641:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970789760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789121315.220723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121315.221148:0:24944:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970789760 00000100:00100000:0.0:1789121315.221157:0:24944:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970789760 00000100:00100000:0.0:1789121315.221335:0:24944:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789121315.221346:0:24944:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970789760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121315.221385:0:24944:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121315.221452:0:24944:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970789760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121315.221460:0:24944:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121315.221550:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970789760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789121315.221628:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789121315.412854:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121315.922164:0:23468:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789121315.922175:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121315.922200:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789121315.922208:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789121315.922355:0:23468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23468:1876028970789888:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789121315.922464:0:23468:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121315.927953:0:23468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23468:1876028970789888:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789121315.931304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121315.931543:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607552 00000100:00100000:1.0:1789121315.931554:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607552 00000100:00100000:1.0:1789121315.931623:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:1.0:1789121315.931644:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19118:x1876028947607552:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789121315.931682:0:23430:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789121315.932017:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19118:x1876028947607552:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 383us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121315.932027:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:3.0:1789121315.943069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.943254:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607680 00000100:00100000:0.0:1789121315.943265:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607680 00000100:00100000:0.0:1789121315.943334:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789121315.943346:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19118:x1876028947607680:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789121315.943431:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943448:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943478:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943551:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943561:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943569:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943594:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943603:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943610:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121315.943670:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789121315.943675:0:23429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789121315.943691:0:23429:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943702:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943710:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943737:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943744:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121315.943748:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943757:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943770:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468886f6500) 00010000:00010000:0.0:1789121315.943773:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121315.943778:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943785:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831159a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943799:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943805:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943874:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943879:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121315.943883:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943899:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943908:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9468b9863100) 00010000:00010000:0.0:1789121315.943910:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121315.943913:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943920:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943935:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943942:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943948:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943953:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121315.943956:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943961:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943968:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121315.943970:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121315.943972:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.943988:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115a8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121315.944065:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19118:x1876028947607680:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 720us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121315.944074:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:3.0:1789121315.950621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121315.950734:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947607936 00000100:00100000:1.0:1789121315.950760:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947607936 00000100:00100000:1.0:1789121315.950864:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:1.0:1789121315.950886:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+37:19118:x1876028947607936:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789121315.950909:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121315.950931:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83115af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f125 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951048:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951065:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951078:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121315.951091:0:23430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789121315.951173:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951181:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951187:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951193:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789121315.951198:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951206:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951227:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:1.0:1789121315.951230:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121315.951236:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951242:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a83115b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951306:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83115af lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f125 expref: 39 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951318:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468886f6500) 00010000:00010000:1.0:1789121315.951321:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789121315.951325:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83115af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f125 expref: 39 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121315.951336:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23400, rc 0) 00000100:00100000:1.0:1789121315.951389:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19118:x1876028947607936:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 516us (776us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1789121315.951398:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:3.0:1789121315.956720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.960231:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947608064 00000100:00100000:0.0:1789121315.960259:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947608064 00000100:00100000:0.0:1789121315.960352:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:0.0:1789121315.960363:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19118:x1876028947608064:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789121315.960408:0:23429:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789121315.960543:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19118:x1876028947608064:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 181us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121315.960551:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:3.0:1789121315.966662:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121315.966857:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947608320 00000100:00100000:2.0:1789121315.966870:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947608320 00000100:00100000:2.0:1789121315.966930:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789121315.966941:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+38:19118:x1876028947608320:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121315.966962:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121315.966983:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115c4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f12c expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789121315.967426:0:23430:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1789121315.967433:0:23430:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1789121315.967453:0:23430:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1789121315.967610:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83115cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.967624:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83115cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.967647:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83115cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.967709:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115c4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f12c expref: 41 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.967738:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83115cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f12c expref: 40 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.967747:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868800) 00010000:00010000:2.0:1789121315.967750:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789121315.967754:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:2.0:1789121315.967847:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:19118:x1876028947608320:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 907us (1196us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789121315.967855:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789121315.976417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.980154:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947608576 00000100:00100000:0.0:1789121315.980173:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947608576 00000100:00100000:0.0:1789121315.980260:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:0.0:1789121315.980271:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:19118:x1876028947608576:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789121315.980343:0:23429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121315.980371:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83115cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f12c expref: 40 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980391:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868800) 00010000:00010000:0.0:1789121315.980402:0:23429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789121315.980428:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980457:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980469:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980550:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980558:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980565:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980615:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980621:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980641:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980647:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121315.980651:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980658:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980666:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121315.980674:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121315.980679:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980685:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a83115d9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980695:0:23429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980701:0:23429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980707:0:23429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980711:0:23429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121315.980714:0:23429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980719:0:23429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980735:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xdbf53920 (ffff9468b9863100) 00010000:00010000:0.0:1789121315.980738:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121315.980741:0:23429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.980747:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115e0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xdbf53920 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121315.980904:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+39:19118:x1876028947608576:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 633us (4496us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789121315.980917:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:3.0:1789121315.987749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121315.987934:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947608704 00000100:00100000:2.0:1789121315.987943:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947608704 00000100:00100000:2.0:1789121315.988010:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:2.0:1789121315.988021:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+39:19118:x1876028947608704:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121315.988059:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121315.988085:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115e7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f133 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988125:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83115ee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988139:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83115ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988150:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83115ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988287:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115e7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f133 expref: 41 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988309:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83115ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f133 expref: 40 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121315.988317:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:2.0:1789121315.988321:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789121315.988325:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:2.0:1789121315.988402:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:19118:x1876028947608704:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 382us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121315.988409:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:3.0:1789121315.993402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121315.996486:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947608960 00000100:00100000:0.0:1789121315.996501:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947608960 00000100:00100000:0.0:1789121315.996577:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:0.0:1789121315.996588:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+40:19118:x1876028947608960:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789121315.997121:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.997141:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.997155:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121315.997346:0:23429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1789121315.997355:0:23429:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766186534149ns, next at 767186531854ns, rc = 0 00000004:00010000:0.0:1789121315.997405:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a9d7d74d reply state 000000008f5a940d transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.997419:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121315.997426:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:0.0:1789121315.997429:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789121315.997433:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789121315.997547:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+42:19118:x1876028947608960:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 959us (4154us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1789121315.997556:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789121316.000769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.001294:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609088 00000100:00100000:2.0:1789121316.001304:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609088 00000100:00100000:2.0:1789121316.001385:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789121316.001397:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+42:19118:x1876028947609088:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121316.001436:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121316.001458:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f13a expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.001520:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 43 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.001537:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 43 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.001557:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:2.0:1789121316.001561:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789121316.001565:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00080000:3.0:1789121316.001701:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121316.001854:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+43:19118:x1876028947609088:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 426us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.001862:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:3.0:1789121316.009508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.011034:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609216 00000100:00100000:2.0:1789121316.011050:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609216 00000100:00100000:2.0:1789121316.011149:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789121316.011164:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2412:x1876028947609216:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789121316.011436:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2412:x1876028947609216:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 277us (1937us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789121316.011446:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00080000:3.0:1789121316.011711:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121316.018429:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.018533:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609472 00000100:00100000:0.0:1789121316.018568:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609472 00000100:00100000:0.0:1789121316.018641:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789121316.018652:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+43:19118:x1876028947609472:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789121316.018970:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+44:19118:x1876028947609472:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 319us (549us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789121316.018979:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789121316.022856:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.022953:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609728 00000100:00100000:2.0:1789121316.022962:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609728 00000100:00100000:2.0:1789121316.023028:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789121316.023038:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+44:19118:x1876028947609728:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789121316.023170:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+44:19118:x1876028947609728:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.023179:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:3.0:1789121316.030190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.030990:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609856 00000100:00100000:2.0:1789121316.031002:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609856 00000100:00100000:2.0:1789121316.031070:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:2.0:1789121316.031079:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+44:19118:x1876028947609856:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121316.031101:0:23430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121316.031123:0:23430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311603 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f141 expref: -99 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031229:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031246:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031273:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121316.031320:0:23430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121316.031341:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031370:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a8311603 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f141 expref: 46 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031390:0:23430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f141 expref: 45 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.031412:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:2.0:1789121316.031415:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789121316.031419:0:23430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:2.0:1789121316.031493:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+45:19118:x1876028947609856:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 414us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.031500:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789121316.038124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.038660:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947609984 00000100:00100000:2.0:1789121316.038671:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947609984 00000100:00100000:2.0:1789121316.038748:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789121316.038759:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+6:2411:x1876028947609984:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121316.038777:0:26049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121316.038802:0:26049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f148 expref: -99 pid: 26049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789121316.038849:0:26049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d323, blocks: 0x0 00010000:00010000:2.0:1789121316.038874:0:26049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=766s v=(0 0) 00010000:00010000:2.0:1789121316.038879:0:26049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121316.038889:0:26049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 7 pid: 26049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.038910:0:26049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 7 pid: 26049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.038926:0:26049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e74000, rc 0) 00000100:00100000:2.0:1789121316.039006:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2411:x1876028947609984:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 248us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.039014:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789121316.049092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.049298:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947610240 00000100:00100000:2.0:1789121316.049309:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947610240 00000100:00100000:2.0:1789121316.049377:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:2.0:1789121316.049388:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+45:19118:x1876028947610240:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789121316.049506:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+45:19118:x1876028947610240:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 119us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.049514:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:3.0:1789121316.058994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.059328:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947610368 00000100:00100000:2.0:1789121316.059340:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947610368 00000100:00100000:2.0:1789121316.059412:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:2.0:1789121316.059423:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+45:19118:x1876028947610368:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789121316.071355:0:23409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1789121316.071378:0:23409:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789121316.071456:0:23409:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1789121316.071662:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+20:19118:x1876028947610368:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 12231us (12666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.071675:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00010000:00010000:0.0:1789121316.072271:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072286:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072296:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072304:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072310:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072319:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072339:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9468886f6400) 00010000:00010000:0.0:1789121316.072343:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072348:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072354:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a83113d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072395:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072401:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072407:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072412:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072415:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072422:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072430:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121316.072433:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072436:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072442:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a83113da lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072457:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072462:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072469:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072480:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072483:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072489:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072498:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9468b9863500) 00010000:00010000:0.0:1789121316.072500:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072503:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072509:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8311482 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072525:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072531:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072537:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072542:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072545:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072550:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072570:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121316.072572:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072575:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072581:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311507 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072593:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072600:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072606:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072611:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072614:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072621:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072628:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121316.072630:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072633:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072638:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a831152a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072664:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072670:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072675:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072682:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072685:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072692:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072701:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121316.072703:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.072706:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072712:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311570 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072736:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072744:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072750:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072763:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.072766:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072773:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072782:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:0.0:1789121316.072785:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789121316.072788:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.072795:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a83115f5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073108:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073130:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073137:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073143:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9acc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121316.073147:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073154:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073165:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:3.0:1789121316.073167:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789121316.073171:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.073178:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8311427 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121316.073634:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789121316.077632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.077734:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947610496 00000100:00100000:0.0:1789121316.077748:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947610496 00000100:00100000:0.0:1789121316.077855:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789121316.077866:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2412:x1876028947610496:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789121316.078020:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2412:x1876028947610496:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 155us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121316.078439:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:1.0:1789121316.089052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.089755:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947610752 00000100:00100000:0.0:1789121316.089774:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947610752 00000100:00100000:1.0:1789121316.090175:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:1.0:1789121316.090209:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+14:19118:x1876028947610752:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789121316.090282:0:23429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121316.090316:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a831160a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f141 expref: 14 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.090342:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:1.0:1789121316.090349:0:23429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789121316.090389:0:23429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8311618 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.090405:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8311618 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.090417:0:23429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8311618 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789121316.090588:0:23429:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f3e35891 reply state 00000000364e0276 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8311618 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.090601:0:23429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8311618 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.090608:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:1.0:1789121316.090611:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789121316.090614:0:23429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789121316.090760:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:19118:x1876028947610752:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 554us (1734us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1789121316.090769:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789121316.091105:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970790016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789121316.091201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121316.093133:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970790016 00000100:00100000:0.0:1789121316.093152:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970790016 00000100:00100000:0.0:1789121316.093238:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789121316.093251:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970790016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789121316.093455:0:26049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789121316.093459:0:26049:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789121316.093462:0:26049:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789121316.093464:0:26049:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789121315 -> 1789121315 00002000:00010000:0.0:1789121316.093466:0:26049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789121316.093553:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970790016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 305us (2352us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789121316.093562:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1789121316.093879:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946783cfa1c0/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789121316.093888:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970790016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789121316.094287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121316.094365:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947610880 00000100:00100000:3.0:1789121316.094371:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947610880 00000100:00100000:3.0:1789121316.094421:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:3.0:1789121316.094430:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:19118:x1876028947610880:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789121316.094443:0:24941:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121316.094463:0:24941:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f14f expref: -99 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.094510:0:24941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.094521:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121316.094526:0:24941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121316.094531:0:24941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.094570:0:24941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.094585:0:24941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121316.094601:0:24941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24941:1876028970790144:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789121316.094689:0:24941:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888a06180 going to sleep for 11 seconds 00000100:00100000:0.0:1789121316.097682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121316.097843:0:24941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24941:1876028970790144:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789121316.097895:0:24941:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.097923:0:24941:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991800, rc 0) 00000100:00100000:3.0:1789121316.097997:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:19118:x1876028947610880:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 3567us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.098039:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121316.102219:0:23415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611008 00000100:00100000:2.0:1789121316.102240:0:23415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611008 00010000:00010000:2.0:1789121316.102312:0:23415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121316.102417:0:23415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789121316.102429:0:23415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2412:x1876028947611008:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121316.102452:0:23415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121316.102480:0:23415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.102498:0:23415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.102528:0:23415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311611 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f148 expref: 8 pid: 26049 timeout: 866 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.102551:0:23415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121316.102556:0:23415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121316.102566:0:23415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.102577:0:23415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.102624:0:23415:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 7 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121316.102670:0:23415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23415:1876028970790272:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789121316.102794:0:23415:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75540 going to sleep for 11 seconds 00000100:00100000:2.0:1789121316.106760:0:23415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23415:1876028970790272:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789121316.106799:0:23415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121316.106920:0:23415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2412:x1876028947611008:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 4491us (9250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.106933:0:23415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789121316.109342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.110252:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611136 00000100:00100000:0.0:1789121316.110267:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611136 00000100:00100000:0.0:1789121316.110356:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789121316.110369:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2412:x1876028947611136:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789121316.110574:0:26049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789121316.110578:0:26049:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789121314 00002000:00010000:0.0:1789121316.110581:0:26049:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789121312 00002000:00010000:0.0:1789121316.110583:0:26049:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789121315 -> 1789121314 00002000:00010000:0.0:1789121316.110587:0:26049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789121316.111389:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2412:x1876028947611136:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 1015us (2055us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789121316.111402:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789121316.116130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.116242:0:24940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611264 00000100:00100000:2.0:1789121316.116254:0:24940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611264 00000100:00100000:2.0:1789121316.116333:0:24940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121316.116346:0:24940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2411:x1876028947611264:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789121316.116415:0:24940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.116446:0:24940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.116457:0:24940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121316.116463:0:24940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789121316.116470:0:24940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.116516:0:24940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 8 pid: 24941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.116560:0:24940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 8 pid: 24941 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121316.116579:0:24940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24940:1876028970790400:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121316.116705:0:24940:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75540 going to sleep for 11 seconds 00000100:00100000:2.0:1789121316.123642:0:24940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24940:1876028970790400:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121316.123686:0:24940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121316.130623:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.131174:0:23414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611392 00000100:00100000:0.0:1789121316.131187:0:23414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611392 00010000:00010000:0.0:1789121316.131256:0:23414:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 9 pid: 24941 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121316.131323:0:23414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789121316.131335:0:23414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+9:2411:x1876028947611392:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121316.131357:0:23414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121316.131385:0:23414:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 9 pid: 24941 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.131402:0:23414:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 9 pid: 24941 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.131432:0:23414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a831161f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f14f expref: 9 pid: 24941 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.131455:0:23414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789121316.131460:0:23414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789121316.131467:0:23414:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.131478:0:23414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.131519:0:23414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121316.132146:0:24940:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132160:0:24940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132187:0:24940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132196:0:24940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132204:0:24940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132230:0:24940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e74000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121316.132235:0:24940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132245:0:24940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132261:0:24940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.132269:0:24940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901f1e35/0xb74d2367a8311626 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121316.132424:0:23414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2411:x1876028947611392:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 1087us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121316.132434:0:23414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789121316.133768:0:24940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:2411:x1876028947611264:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 17406us (17636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.133784:0:24940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:1.0:1789121316.137196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.137271:0:24965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611648 00000100:00100000:0.0:1789121316.137283:0:24965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611648 00000100:00100000:0.0:1789121316.137354:0:24965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:0.0:1789121316.137367:0:24965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:19118:x1876028947611648:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789121316.137472:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.137495:0:24965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 15 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.137507:0:24965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.137550:0:24965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 15 pid: 24965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.137564:0:24965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 15 pid: 24965 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121316.137581:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970790528:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121316.137689:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121316.139693:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b92580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970790528:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121316.139737:0:24965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121316.141239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.141325:0:26470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611776 00000100:00100000:0.0:1789121316.141334:0:26470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611776 00010000:00010000:0.0:1789121316.141386:0:26470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 16 pid: 24965 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121316.141456:0:26470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121316.141467:0:26470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+16:2412:x1876028947611776:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121316.141486:0:26470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121316.141494:0:26470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 16 pid: 24965 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141508:0:26470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 16 pid: 24965 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141535:0:26470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8311500 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f0ed expref: 16 pid: 24965 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141555:0:26470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121316.141562:0:26470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 15 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141572:0:26470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141580:0:26470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141589:0:26470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.141626:0:26470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121316.141694:0:26470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:2412:x1876028947611776:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 228us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121316.141708:0:26470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00010000:00010000:1.0:1789121316.142214:0:24965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142224:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142491:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142505:0:24965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 15 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142513:0:24965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142547:0:24965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 15 pid: 23430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.142562:0:24965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 15 pid: 23430 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121316.142578:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970790656:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789121316.143006:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121316.150734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.150979:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970790656:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121316.151017:0:24965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121316.151383:0:23416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947611904 00000100:00100000:3.0:1789121316.151394:0:23416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947611904 00010000:00010000:3.0:1789121316.151447:0:23416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 16 pid: 23430 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121316.151528:0:23416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789121316.151540:0:23416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468abbca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+16:2412:x1876028947611904:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121316.151560:0:23416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121316.151568:0:23416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 16 pid: 23430 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151582:0:23416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 16 pid: 23430 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151611:0:23416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83115fc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f13a expref: 16 pid: 23430 timeout: 866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151640:0:23416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:3.0:1789121316.151646:0:23416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151659:0:23416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151669:0:23416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.151727:0:23416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121316.151804:0:23416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468abbca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+15:2412:x1876028947611904:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 266us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.151812:0:23416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00010000:00010000:2.0:1789121316.152337:0:24965:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.152347:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789121316.152510:0:24965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1789121316.152651:0:24965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1789121316.152690:0:24965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1789121316.152805:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24965:1876028970790784:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789121316.152906:0:24965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.152942:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75780 going to sleep for 11 seconds 00000100:00100000:1.0:1789121316.154038:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970790784 00000100:00100000:1.0:1789121316.154050:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970790784 00000100:00100000:1.0:1789121316.154115:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789121316.154126:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:24965:x1876028970790784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789121316.154271:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:24965:x1876028970790784:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.154294:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789121316.154359:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24965:1876028970790784:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789121316.154563:0:24965:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1789121316.155063:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24965:1876028970790912:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789121316.155123:0:24965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121316.155156:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121316.155902:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970790912 00000100:00100000:0.0:1789121316.155911:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970790912 00000100:00100000:0.0:1789121316.155967:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789121316.155977:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:24965:x1876028970790912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789121316.156189:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:24965:x1876028970790912:12345-0@lo:1000:mdt00_003.0 Request processed in 213us (1066us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789121316.156197:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121316.156399:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:24965:1876028970790912:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789121316.156461:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156474:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156483:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156490:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121316.156496:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156505:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156526:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:2.0:1789121316.156529:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789121316.156536:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156543:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a8311634 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156600:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156607:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156614:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156619:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121316.156624:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156643:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156652:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121316.156655:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789121316.156663:0:24965:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 18 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156675:0:24965:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 18 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156685:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 18 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.156759:0:24965:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a8311593 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f11e expref: 18 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121316.156787:0:24965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970791040:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789121316.157015:0:24965:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121316.162289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121316.162811:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947612032 00000100:00100000:3.0:1789121316.162864:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947612032 00000100:00100000:2.0:1789121316.163169:0:24965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24965:1876028970791040:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789121316.163210:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163223:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a831158c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163264:0:24965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163281:0:24965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163293:0:24965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163304:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163309:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163316:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163321:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121316.163326:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163352:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163366:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121316.163369:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121316.163373:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.163378:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2400/0xb74d2367a831163b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121316.165643:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789121316.165676:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19115:x1876028947612032:12345-192.168.202.32@tcp:49:bash.0 00000100:00100000:3.0:1789121316.165911:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19115:x1876028947612032:12345-192.168.202.32@tcp:49:bash.0 Request processed in 252us (3636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.165919:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00010000:00010000:2.0:1789121316.166009:0:24965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166021:0:24965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166029:0:24965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166036:0:24965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121316.166041:0:24965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166049:0:24965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166066:0:24965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:2.0:1789121316.166069:0:24965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789121316.166075:0:24965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121316.166102:0:24965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a831162d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24965 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121316.166353:0:23468:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789121316.166359:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121316.166376:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789121316.166382:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789121316.166458:0:24965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+18:19118:x1876028947611648:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 29093us (29275us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1789121316.166469:0:24965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000020:00080000:2.0:1789121316.166474:0:24965:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789121316.172695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121316.173482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121316.173602:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947612160 00000100:00100000:1.0:1789121316.173615:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947612160 00000100:00100000:1.0:1789121316.173703:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:1.0:1789121316.173716:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+7:19115:x1876028947612160:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789121316.174001:0:24942:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121316.174065:0:24942:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f41b891/0xb74d2367a8311642 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f156 expref: -99 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789121316.174102:0:24942:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa3d322, atime: 0x6aa3d320, ctime: 0x6aa3d322, blocks: 0x0 00010000:00010000:1.0:1789121316.174129:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=766s v=(0 0) 00010000:00010000:1.0:1789121316.174134:0:24942:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121316.174146:0:24942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f41b891/0xb74d2367a8311642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f156 expref: 8 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.174164:0:24942:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f41b891/0xb74d2367a8311642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f156 expref: 8 pid: 24942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.174179:0:24942:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23c00, rc 0) 00000100:00100000:1.0:1789121316.174308:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:19115:x1876028947612160:12345-192.168.202.32@tcp:101:bash.0 Request processed in 594us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.174338:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:1.0:1789121316.177064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121316.177170:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947612544 00000100:00100000:3.0:1789121316.177181:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947612544 00000100:00100000:3.0:1789121316.177259:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:3.0:1789121316.177272:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+18:19115:x1876028947612544:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789121316.177308:0:23431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121316.177339:0:23431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311649 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f15d expref: -99 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177381:0:23431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8311650 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177399:0:23431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8311650 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177411:0:23431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8311650 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177582:0:23431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8311649 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f15d expref: 20 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177606:0:23431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8311650 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f15d expref: 19 pid: 23431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121316.177615:0:23431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:3.0:1789121316.177619:0:23431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789121316.177623:0:23431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990400, rc 0) 00000100:00100000:3.0:1789121316.177702:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19115:x1876028947612544:12345-192.168.202.32@tcp:101:bash.0 Request processed in 432us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.177711:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:0.0:1789121316.180802:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947612416 00000100:00100000:0.0:1789121316.180841:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947612416 00000100:00100000:0.0:1789121316.180932:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789121316.180945:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+19:19118:x1876028947612416:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789121316.181312:0:23432:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789121316.181354:0:23432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:0.0:1789121316.181397:0:23432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181421:0:23432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181436:0:23432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181446:0:23432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181475:0:23432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181483:0:23432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.181519:0:23432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789121316.181708:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19118:x1876028947612416:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 764us (8944us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1789121316.181716:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000020:00080000:0.0:1789121316.181732:0:23432:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789121316.183893:0:25734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121316.183912:0:25734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.183926:0:25734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121316.183931:0:25734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.183942:0:25734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.183966:0:25734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9468c0868100) 00010000:00010000:1.0:1789121316.183970:0:25734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789121316.183976:0:25734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.183983:0:25734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8311657 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121316.184008:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121316.184011:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121316.184013:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121316.191703:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.191995:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947612800 00000100:00100000:0.0:1789121316.192008:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947612800 00000100:00100000:0.0:1789121316.192086:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:0.0:1789121316.192099:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+21:19115:x1876028947612800:12345-192.168.202.32@tcp:35:bash.0 00000001:00080000:0.0:1789121316.192398:0:23432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:0.0:1789121316.192538:0:23432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:0.0:1789121316.192685:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+24:19115:x1876028947612800:12345-192.168.202.32@tcp:35:bash.0 Request processed in 587us (1001us total) trans 12884901929 rc 0/0 00000100:00100000:0.0:1789121316.192695:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000020:00080000:0.0:1789121316.192701:0:23432:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789121316.246225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970791168:0@lo:400:kworker.0 00000100:00100000:0.0:1789121316.246337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121316.246394:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970791296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121316.246428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.246481:0:23421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791168 00000100:00100000:2.0:1789121316.246492:0:23421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791168 00000100:00100000:2.0:1789121316.246563:0:23421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789121316.246573:0:23421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3647:x1876028970791168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.246642:0:23421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c+24:3647:x1876028970791168:12345-0@lo:400:kworker.0 Request processed in 69us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.246650:0:23421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789121316.247203:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121316.247218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970791424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789121316.251014:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970791936:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.251150:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970792448:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.251199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789121316.251204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970791552:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.251266:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970792064:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.251300:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970792576:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121316.251350:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791936 00000100:00100000:2.0:1789121316.251358:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791936 00000100:00100000:2.0:1789121316.251408:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791552 00000100:00100000:2.0:1789121316.251410:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791552 00000100:00100000:2.0:1789121316.251425:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789121316.251433:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970791936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251489:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970791936:12345-0@lo:400:kworker.0 Request processed in 56us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.251496:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789121316.251512:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121316.251518:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970791552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251539:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970791552:12345-0@lo:400:kworker.0 Request processed in 22us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.251544:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121316.251577:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970791552:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251586:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970791936:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251614:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792448 00000100:00100000:2.0:1789121316.251617:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792448 00000100:00100000:2.0:1789121316.251650:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792576 00000100:00100000:2.0:1789121316.251652:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792576 00000100:00100000:2.0:1789121316.251672:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789121316.251684:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970792448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251715:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970792448:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.251735:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789121316.251763:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970792448:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251779:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789121316.251786:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.251816:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970792576:12345-0@lo:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.251849:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1789121316.251872:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467849a30c0 x1876028970792576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121316.251882:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970792576:0@lo:400:kworker.0 00000100:00080000:3.0:1789121316.252062:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789121316.252067:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121316.252079:0:24941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792064 00000100:00100000:3.0:1789121316.252083:0:24941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792064 00000100:00100000:3.0:1789121316.252143:0:24941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789121316.252150:0:24941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970792064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121316.252195:0:24941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970792064:12345-0@lo:400:kworker.0 Request processed in 46us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.252202:0:24941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789121316.252232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970792064:0@lo:400:kworker.0 00000100:00080000:2.0:1789121316.252572:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121316.254373:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791296 00000100:00100000:1.0:1789121316.254389:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791296 00000100:00100000:1.0:1789121316.254462:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789121316.254506:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970791296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789121316.254547:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121316.258686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121316.265189:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970791296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10702us (18743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.265210:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789121316.265256:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791424 00000100:00100000:1.0:1789121316.265267:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791424 00000100:00100000:1.0:1789121316.265318:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789121316.265328:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970791424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789121316.265361:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789121316.265414:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970791424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.265420:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789121316.265449:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121316.265473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970791680:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.265645:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970791424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121316.266245:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970791296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121316.266292:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970791808:0@lo:400:kworker.0 00000100:00100000:0.0:1789121316.266349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121316.266384:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970792320:0@lo:400:kworker.0 00000100:00100000:0.0:1789121316.266409:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121316.266444:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970792832:0@lo:400:kworker.0 00000100:00100000:0.0:1789121316.266469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121316.266495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4ea47eb7-f73f-4e5e-957f-1a8c2d51392c:3647:1876028970791168:0@lo:400:kworker.0 00000100:00100000:3.0:1789121316.266615:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791808 00000100:00100000:3.0:1789121316.266621:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791808 00000100:00100000:3.0:1789121316.266676:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792320 00000100:00100000:3.0:1789121316.266680:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792320 00000100:00100000:3.0:1789121316.266693:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792832 00000100:00100000:3.0:1789121316.266696:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792832 00000100:00100000:3.0:1789121316.266907:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789121316.266920:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970791808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121316.266979:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970791808:12345-0@lo:400:kworker.0 Request processed in 62us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.266985:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1789121316.266991:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121316.267004:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789121316.267010:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970792320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121316.267035:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970792320:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.267041:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789121316.267050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970792192:0@lo:400:kworker.0 00000100:00100000:3.0:1789121316.267052:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789121316.267058:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970792832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267071:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121316.267083:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970792832:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121316.267089:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789121316.267093:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970791680 00000100:00100000:1.0:1789121316.267097:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970791680 00000100:00100000:3.0:1789121316.267117:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970791808:0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267122:0:26049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792192 00000100:00100000:1.0:1789121316.267125:0:26049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792192 00000100:00100000:3.0:1789121316.267127:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970792320:0@lo:400:kworker.0 00010000:00080000:3.0:1789121316.267140:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467849a3c00 x1876028970792832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121316.267144:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121316.267150:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970791680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121316.267151:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970792832:0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267181:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970791680:12345-0@lo:400:kworker.0 Request processed in 31us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.267188:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121316.267200:0:26049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121316.267206:0:26049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970792192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267242:0:26049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970792192:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121316.267249:0:26049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789121316.267274:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970792192:0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970792704:0@lo:400:kworker.0 00000100:00100000:1.0:1789121316.267311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121316.267356:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970791680:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.267363:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792704 00000100:00100000:2.0:1789121316.267367:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792704 00000100:00080000:1.0:1789121316.267400:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121316.267447:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789121316.267456:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970792704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.267507:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970792704:12345-0@lo:400:kworker.0 Request processed in 52us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121316.267514:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789121316.268983:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970792704:0@lo:400:kworker.0 00000100:00100000:2.0:1789121316.291099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.292902:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613056 00000100:00100000:0.0:1789121316.292921:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613056 00000100:00100000:0.0:1789121316.293028:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:0.0:1789121316.293040:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+24:19128:x1876028947613056:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789121316.293077:0:23429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121316.293101:0:23429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831165e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7f164 expref: -99 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121316.293223:0:23429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789121316.293353:0:23429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831165e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f164 expref: 26 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.293369:0:23429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468b9862500) 00010000:00010000:0.0:1789121316.293373:0:23429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789121316.293379:0:23429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a831165e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7f164 expref: 26 pid: 23429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.293398:0:23429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0800, rc 0) 00000100:00100000:0.0:1789121316.293505:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19128:x1876028947613056:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 467us (2421us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1789121316.293513:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:2.0:1789121316.299360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.299455:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613184 00000100:00100000:0.0:1789121316.299468:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613184 00000100:00100000:0.0:1789121316.299544:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:0.0:1789121316.299555:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19128:x1876028947613184:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:0.0:1789121316.299655:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.299677:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.299691:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.299709:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.299716:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.299735:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300067:0:23430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300078:0:23430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300086:0:23430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789121316.300170:0:23430:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300185:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300193:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300201:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300208:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.300213:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300221:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300237:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9468886f6d00) 00010000:00010000:0.0:1789121316.300240:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.300246:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300252:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a831166c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300271:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300277:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300288:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300293:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.300297:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300303:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300311:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9468ba9d4a00) 00010000:00010000:0.0:1789121316.300313:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.300316:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300322:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8311673 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300339:0:23430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300344:0:23430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300349:0:23430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300354:0:23430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121316.300357:0:23430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300371:0:23430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300379:0:23430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9468b9863e00) 00010000:00010000:0.0:1789121316.300382:0:23430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121316.300384:0:23430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121316.300390:0:23430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1a00/0xb74d2367a831167a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121316.300988:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19128:x1876028947613184:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1429us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121316.301000:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:1.0:1789121316.309215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121316.309381:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613440 00000100:00100000:0.0:1789121316.309394:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613440 00000100:00100000:0.0:1789121316.309473:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789121316.309486:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+25:19128:x1876028947613440:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121316.310200:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+26:19128:x1876028947613440:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 714us (1001us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1789121316.310211:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:3.0:1789121316.438300:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121317.202189:0:23468:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789121317.202206:0:23468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121317.202231:0:23468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789121317.202239:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1789121317.460232:0:23417:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789121318.158370:0:26524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1789121318.482310:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121318.861090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121318.861392:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613952 00000100:00100000:2.0:1789121318.861402:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613952 00000100:00100000:2.0:1789121318.861467:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614080 00000100:00100000:2.0:1789121318.861471:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614080 00000100:00100000:2.0:1789121318.861483:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614464 00000100:00100000:2.0:1789121318.861486:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614464 00000100:00100000:2.0:1789121318.861500:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614592 00000100:00100000:2.0:1789121318.861502:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614592 00000100:00100000:2.0:1789121318.861516:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789121318.861525:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2409:x1876028947613952:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121318.861601:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2409:x1876028947613952:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121318.861609:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789121318.861629:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121318.861653:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947614080:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121318.861681:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947614080:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121318.861686:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121318.861709:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789121318.861717:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2409:x1876028947614464:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121318.861739:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2409:x1876028947614464:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121318.861744:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789121318.861756:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789121318.861761:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947614592:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121318.861781:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947614592:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 19us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121318.861787:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00080000:2.0:1789121318.861860:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789121318.861865:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121318.864583:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613696 00000100:00100000:0.0:1789121318.864599:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613696 00000100:00100000:0.0:1789121318.864673:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613824 00000100:00100000:0.0:1789121318.864677:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613824 00000100:00100000:0.0:1789121318.864690:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614208 00000100:00100000:0.0:1789121318.864693:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614208 00000100:00100000:0.0:1789121318.864720:0:23429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614336 00000100:00100000:0.0:1789121318.864738:0:23429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614336 00000100:00100000:0.0:1789121318.864765:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121318.864774:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+26:2409:x1876028947613696:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121318.864892:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+26:2409:x1876028947613696:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 119us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121318.864901:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121318.864919:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789121318.864925:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947613824:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121318.864952:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+5:2410:x1876028947613824:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121318.864958:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789121318.864970:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789121318.864976:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2409:x1876028947614208:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121318.865003:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+6:2409:x1876028947614208:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (3691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121318.865009:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789121318.865020:0:23429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:0.0:1789121318.865026:0:23429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947614336:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121318.865051:0:23429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a2cd91-c608-4b81-82c0-46b7dff07711+5:2410:x1876028947614336:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121318.865057:0:23429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00080000:2.0:1789121318.865298:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121318.865303:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121318.868466:0:23424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947613568 00000100:00100000:1.0:1789121318.868481:0:23424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947613568 00000100:00100000:1.0:1789121318.868560:0:23424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:1.0:1789121318.868572:0:23424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2410:x1876028947613568:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121318.868679:0:23424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b3dee28e-700e-4632-b33d-fd4587623bcd+13:2410:x1876028947613568:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 108us (7601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121318.868687:0:23424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:2.0:1789121319.325231:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121319.325262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970792960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121319.325352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121319.325410:0:24943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970792960 00000100:00100000:2.0:1789121319.325419:0:24943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970792960 00000100:00100000:2.0:1789121319.325494:0:24943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121319.325506:0:24943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970792960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121319.325560:0:24943:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121319.325616:0:24943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970792960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121319.325623:0:24943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789121319.325651:0:23425:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121319.325712:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970792960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121319.378164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121319.378282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121319.378325:0:24942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614848 00000100:00100000:2.0:1789121319.378336:0:24942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614848 00000100:00100000:2.0:1789121319.378417:0:24942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789121319.378429:0:24942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2412:x1876028947614848:12345-192.168.202.32@tcp:16:kworker.0 00000100:00100000:2.0:1789121319.378576:0:24942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2412:x1876028947614848:12345-192.168.202.32@tcp:16:kworker.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121319.378584:0:24942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789121319.379027:0:24945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947614720 00000100:00100000:0.0:1789121319.379033:0:24945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947614720 00002000:00100000:0.0:1789121319.379067:0:24945:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9468914da580 x1876028947614720/t0(0) o4->e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp:95/0 lens 504/0 e 0 to 0 dl 1789121330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789121319.379106:0:24945:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914da580 with x1876028947614720 ext(0->8) 00002000:00010000:0.0:1789121319.379114:0:24945:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914da580 00000100:00100000:0.0:1789121319.379141:0:24945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789121319.379149:0:24945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+8:2412:x1876028947614720:12345-192.168.202.32@tcp:4:bash.0 00000100:00100000:0.0:1789121319.382058:0:24945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff+10:2412:x1876028947614720:12345-192.168.202.32@tcp:4:bash.0 Request processed in 2894us (3759us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789121319.382077:0:24945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00002000:00100000:0.0:1789121319.382092:0:24945:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9468914da580 x1876028947614720/t12884901895(0) o4->e44c80dc-fc02-4a6d-a3b1-c6a0f1ade1ff@192.168.202.32@tcp:95/0 lens 504/448 e 0 to 0 dl 1789121330 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789121319.382105:0:24945:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914da580 with x1876028947614720 ext(0->8) 00002000:00010000:0.0:1789121319.382112:0:24945:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914da580 00010000:00010000:0.0:1789121319.507482:0:23418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121319.827559:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789121319.827595:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970793088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121319.827712:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121319.827795:0:23435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970793088 00000100:00100000:1.0:1789121319.827805:0:23435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970793088 00000100:00100000:1.0:1789121319.827905:0:23435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121319.827916:0:23435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970793088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121319.827971:0:23435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121319.829309:0:23435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970793088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1384us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121319.829532:0:23435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121319.829644:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970793088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121319.833932:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789121319.833966:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970793216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121319.834089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121319.835143:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970793216 00000100:00100000:2.0:1789121319.835158:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970793216 00000100:00100000:3.0:1789121319.837171:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789121319.837190:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970793216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121319.837317:0:24172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789121319.837432:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970793216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 247us (3354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121319.837441:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789121319.838067:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970793216:0@lo:41:osp-pre-0-1.0 Debug log: 14654 lines, 14654 kept, 0 dropped, 0 bad.