00010000:00010000:0.0F:1787599642.084996:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1787599643.122915:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599643.181178:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578060288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599643.181257:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599643.181330:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060288 00000100:00100000:0.0:1787599643.181338:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060288 00000100:00100000:0.0:1787599643.181388:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787599643.181399:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578060288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787599643.181429:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599643.181474:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578060288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599643.181482:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787599643.182652:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599643.182716:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578060288:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0F:1787599643.184570:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1787599643.184619:0:17078:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96b242d18e40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1787599643.184624:0:17078:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b344b76800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96b242d18cc0 00000020:00080000:3.0:1787599643.184628:0:17078:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96b344b76f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96b34e5ac000 00010000:00010000:2.0F:1787599643.186769:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186823:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186832:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186839:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54be00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599643.186844:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186861:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186881:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:2.0:1787599643.186885:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599643.186893:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599643.186909:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54be00/0x5d2988b0929d0bdb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787599643.186948:0:17137:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1787599643.187033:0:17137:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787599643.685021:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599643.685047:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578060416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599643.685147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599643.685332:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060416 00000100:00100000:2.0:1787599643.685340:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060416 00000100:00100000:2.0:1787599643.685400:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599643.685410:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578060416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599643.685453:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787599643.685516:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578060416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.685535:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787599643.685832:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599643.685844:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578060544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599643.685880:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.685921:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060544 00000100:00100000:3.0:1787599643.685925:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060544 00000100:00100000:3.0:1787599643.685967:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787599643.685975:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578060544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787599643.685994:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787599643.686028:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578060544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599643.686034:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787599643.686049:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599643.686084:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2419c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578060544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599643.686304:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578060672:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.686328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.686344:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578061184:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.686358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.686404:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578061696:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.686419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.686654:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578061056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.686686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.686716:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578061568:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.686787:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578060800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.686848:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.686871:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578061312:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.686893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.686910:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578061824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599643.687783:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061056 00000100:00100000:0.0:1787599643.687805:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061056 00000100:00100000:0.0:1787599643.687858:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061312 00000100:00100000:0.0:1787599643.687861:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061312 00000100:00100000:0.0:1787599643.687885:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599643.687894:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578061056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599643.687961:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578061056:12345-0@lo:400:kworker.0 Request processed in 68us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599643.687968:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599643.687984:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599643.687990:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578061312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599643.688026:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578061312:12345-0@lo:400:kworker.0 Request processed in 36us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599643.688032:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787599643.688048:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787599643.688058:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599643.689405:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060800 00000100:00100000:0.0:1787599643.689418:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060800 00000100:00100000:0.0:1787599643.689464:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787599643.689474:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578060800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599643.689551:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578060800:12345-0@lo:400:kworker.0 Request processed in 79us (2701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599643.689558:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787599643.691086:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599643.691104:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578062080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599643.691157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.691197:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578060928:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.691228:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.691249:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578061440:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.691272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599643.691312:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061184 00000100:00100000:2.0:1787599643.691319:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061184 00000100:00100000:2.0:1787599643.691369:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061696 00000100:00100000:2.0:1787599643.691373:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061696 00000100:00100000:2.0:1787599643.691405:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599643.691415:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578061184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.691473:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b38138ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578061184:12345-0@lo:400:kworker.0 Request processed in 61us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.691495:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599643.691512:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599643.691519:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578061696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.691549:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2419c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578061696:12345-0@lo:400:kworker.0 Request processed in 31us (5128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.691554:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787599643.691585:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599643.692074:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060672 00000100:00100000:2.0:1787599643.692081:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060672 00000100:00100000:2.0:1787599643.692111:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787599643.692118:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3648:x1874433578060672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.692154:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3648:x1874433578060672:12345-0@lo:400:kworker.0 Request processed in 36us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.692161:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787599643.692295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578061952:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.692325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.692378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599643.692396:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062080 00000100:00100000:3.0:1787599643.692400:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062080 00000100:00100000:3.0:1787599643.692428:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599643.692434:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578062080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787599643.692449:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787599643.692491:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578062080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599643.692498:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599643.692516:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578060928 00000100:00100000:3.0:1787599643.692519:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578060928 00000100:00100000:3.0:1787599643.692546:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599643.692551:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578060928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.692592:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578060928:12345-0@lo:400:kworker.0 Request processed in 42us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599643.692598:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787599643.692641:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3434a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578062080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599643.692653:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578060672:0@lo:400:kworker.0 00000100:00100000:3.0:1787599643.692663:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578061184:0@lo:400:kworker.0 00010000:00080000:3.0:1787599643.692690:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa07100 x1874433578061696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599643.692706:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578061696:0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.693135:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061440 00000100:00100000:2.0:1787599643.693141:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061440 00000100:00100000:2.0:1787599643.693167:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061952 00000100:00100000:2.0:1787599643.693170:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061952 00000100:00100000:2.0:1787599643.693209:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599643.693215:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578061440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.693254:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578061440:12345-0@lo:400:kworker.0 Request processed in 39us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.693259:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599643.693272:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599643.693279:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578061952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.693307:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578061952:12345-0@lo:400:kworker.0 Request processed in 29us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599643.693313:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787599643.693345:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599643.697129:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578060928:0@lo:400:kworker.0 00000100:00100000:2.0:1787599643.697151:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578061440:0@lo:400:kworker.0 00010000:00080000:2.0:1787599643.697175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa04700 x1874433578061952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599643.697186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578061952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578060416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599643.699084:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578060800:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699099:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578061312:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699139:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061824 00000100:00100000:1.0:1787599643.699145:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061824 00000100:00080000:1.0:1787599643.699175:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599643.699221:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787599643.699231:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578061824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699306:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578061824:12345-0@lo:400:kworker.0 Request processed in 76us (6928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599643.699313:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599643.699327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599643.699345:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578061824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599643.699363:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578061056:0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699376:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578061568 00000100:00100000:1.0:1787599643.699380:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578061568 00000100:00080000:0.0:1787599643.699400:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599643.699408:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787599643.699415:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578061568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599643.699459:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578061568:12345-0@lo:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599643.699465:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599643.699495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578061568:0@lo:400:kworker.0 00000040:00080000:0.0:1787599643.943873:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599643.943885:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599643.943906:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787599643.943912:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787599644.108668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599644.111607:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111424 00000100:00100000:0.0:1787599644.111623:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111424 00000100:00100000:0.0:1787599644.111770:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00100000:0.0:1787599644.111782:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:15582:x1874433559111424:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787599644.111908:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:15582:x1874433559111424:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 130us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599644.111916:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 65 00000100:00080000:2.0:1787599644.116923:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599644.124142:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599644.124243:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111552 00000100:00100000:0.0:1787599644.124254:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111552 00000100:00100000:0.0:1787599644.124332:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00100000:0.0:1787599644.124344:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15582:x1874433559111552:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787599644.124462:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:15582:x1874433559111552:12345-192.168.202.1@tcp:60:lhsmtool_posix.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599644.124471:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 66 00000100:00080000:2.0:1787599644.124639:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787599644.139587:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599644.139926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599644.140935:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111808 00000100:00100000:3.0:1787599644.140949:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111808 00000100:00100000:3.0:1787599644.141015:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599644.141026:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:15582:x1874433559111808:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787599644.141344:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+14:15582:x1874433559111808:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 318us (1424us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787599644.141352:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:3.0:1787599644.197168:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578062208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599644.197251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599644.197416:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062208 00000100:00100000:2.0:1787599644.197426:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062208 00000100:00100000:2.0:1787599644.197481:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599644.197501:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578062208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599644.197522:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599644.197606:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578062208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599644.197614:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599644.197661:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578062208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599644.198561:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578062336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599644.198625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599644.198663:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062336 00000100:00100000:1.0:1787599644.198668:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062336 00000100:00100000:1.0:1787599644.198703:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787599644.198710:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578062336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599644.198788:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599644.198903:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578062336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599644.198908:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599644.198944:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578062336:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599645.157045:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599645.641985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.642079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.642112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599645.642190:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112192 00000100:00100000:3.0:1787599645.642200:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112192 00000100:00100000:3.0:1787599645.642253:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112064 00000100:00100000:3.0:1787599645.642256:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112064 00000100:00100000:3.0:1787599645.642279:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1787599645.642288:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559112192:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599645.642360:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2405:x1874433559112192:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599645.642368:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 74 00000100:00100000:3.0:1787599645.642384:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:3.0:1787599645.642390:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+14:2405:x1874433559112064:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599645.642418:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+14:2405:x1874433559112064:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599645.642424:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 75 00000100:00100000:1.0:1787599645.643261:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559111936 00000100:00100000:1.0:1787599645.643268:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559111936 00000100:00100000:1.0:1787599645.643355:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:1.0:1787599645.643365:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559111936:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599645.643413:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34ede0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559111936:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 50us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599645.643419:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 170 00000100:00100000:2.0:1787599645.653788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.653860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.653890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.653908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.653937:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112576 00000100:00100000:2.0:1787599645.653948:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112576 00000100:00100000:2.0:1787599645.654001:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112704 00000100:00100000:2.0:1787599645.654003:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112704 00000100:00100000:2.0:1787599645.654021:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1787599645.654030:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559112576:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599645.654103:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2405:x1874433559112576:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599645.654111:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 76 00000100:00100000:2.0:1787599645.654125:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00100000:2.0:1787599645.654130:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559112704:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599645.654148:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2406:x1874433559112704:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 18us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599645.654154:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 77 00000100:00080000:2.0:1787599645.654181:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599645.654184:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599645.654314:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112320 00000100:00100000:0.0:1787599645.654318:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112320 00000100:00100000:0.0:1787599645.654351:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112448 00000100:00100000:0.0:1787599645.654353:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112448 00000100:00100000:0.0:1787599645.654370:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599645.654377:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559112448:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599645.654401:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2406:x1874433559112448:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599645.654407:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599645.654418:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1787599645.654423:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2402:x1874433559112320:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:0.0:1787599645.654440:0:18992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d090a 00000100:00080000:0.0:1787599645.654454:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b244235000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599645.654491:0:18992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787599645.654630:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+2:2402:x1874433559112320:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 205us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599645.654635:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00010000:00010000:0.0:1787599645.654658:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599645.655233:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599645.655237:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599645.659483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599645.659664:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112832 00000100:00100000:2.0:1787599645.659675:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112832 00000100:00100000:2.0:1787599645.659759:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1787599645.659770:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+5:2402:x1874433559112832:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:2.0:1787599645.659867:0:18992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0949 00000100:00080000:2.0:1787599645.659877:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b34e544800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599645.659918:0:18992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787599645.660068:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd7a1775-f008-45c6-8360-bad6104f0230+2:2402:x1874433559112832:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 298us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599645.660076:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00080000:0.0:1787599645.660229:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787599645.660408:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599645.660962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599645.661028:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559112960 00000100:00100000:3.0:1787599645.661035:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559112960 00000100:00100000:1.0:1787599645.661157:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:1.0:1787599645.661169:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2402:x1874433559112960:12345-192.168.202.1@tcp:9:kworker.0 00000020:00000080:1.0:1787599645.661196:0:18604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0950 00000100:00080000:1.0:1787599645.661210:0:18604:0:(import.c:65:import_set_state_nolock()) ffff96b34e544000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599645.661260:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787599645.661369:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd7a1775-f008-45c6-8360-bad6104f0230+2:2402:x1874433559112960:12345-192.168.202.1@tcp:9:kworker.0 Request processed in 203us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599645.661377:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00080000:0.0:1787599645.661581:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787599645.661702:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599646.182184:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599647.212456:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787599647.704220:0:20474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 15:27:26 (1787599646) 00010000:00010000:1.0:1787599648.233751:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599648.296309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599648.296334:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578062464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599648.296416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599648.296473:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062464 00000100:00100000:1.0:1787599648.296480:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062464 00000100:00100000:1.0:1787599648.296530:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599648.296553:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578062464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599648.296582:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599648.296623:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578062464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599648.296630:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787599648.296650:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599648.296679:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578062464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599648.805741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578062592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599648.805913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599648.806387:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578062720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599648.806421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599648.806491:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787599648.806500:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578062848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599648.806540:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599648.806574:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062592 00000100:00100000:2.0:1787599648.806583:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062592 00000100:00100000:2.0:1787599648.806641:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062720 00000100:00100000:2.0:1787599648.806644:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062720 00000100:00100000:2.0:1787599648.806664:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599648.806675:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578062592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599648.806736:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599648.806781:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578062592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599648.806789:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599648.806827:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599648.806834:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578062720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599648.806844:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599648.806874:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578062720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599648.806880:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599648.806929:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578062720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599648.807324:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24340a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578062592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787599648.807361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578063104:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.807420:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599648.807426:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578063232:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.807514:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063232 00000100:00100000:3.0:1787599648.807519:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063232 00000100:00100000:3.0:1787599648.807566:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599648.807574:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578063232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807613:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578063232:12345-0@lo:400:kworker.0 Request processed in 41us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599648.807620:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599648.807647:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578062976:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.807700:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578063488:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.807739:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599648.807744:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578063360:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.807817:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578063232:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807858:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063360 00000100:00100000:3.0:1787599648.807863:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063360 00000100:00100000:3.0:1787599648.807890:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599648.807896:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578063360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.807933:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578063360:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599648.807954:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599648.807974:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062976 00000100:00100000:3.0:1787599648.807977:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062976 00000100:00100000:3.0:1787599648.808002:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599648.808008:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578062976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.808053:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3646:x1874433578062976:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599648.808059:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787599648.808092:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578063360:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.808102:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578062976:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.808664:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578062848 00000100:00100000:1.0:1787599648.808672:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578062848 00000100:00100000:1.0:1787599648.808700:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063104 00000100:00100000:1.0:1787599648.808704:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063104 00000100:00100000:1.0:1787599648.808719:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599648.808726:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578062848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599648.808763:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787599648.808826:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578062848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599648.808833:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787599648.808850:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787599648.808856:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578063104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.808892:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24340a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578063104:12345-0@lo:400:kworker.0 Request processed in 37us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599648.808898:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787599648.808915:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599648.808930:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063488 00000100:00100000:1.0:1787599648.808934:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063488 00000100:00100000:1.0:1787599648.808967:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599648.808974:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578063488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.809007:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578063488:12345-0@lo:400:kworker.0 Request processed in 34us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599648.809013:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787599648.809026:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599648.809051:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578063104:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.809389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578063488:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.809408:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578062848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599648.812038:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578063616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.812128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.812234:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063616 00000100:00100000:3.0:1787599648.812244:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063616 00000100:00100000:3.0:1787599648.812313:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787599648.812325:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578063616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599648.812737:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578063744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599648.812769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599648.812823:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063744 00000100:00100000:2.0:1787599648.812827:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063744 00000100:00100000:2.0:1787599648.812866:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787599648.812874:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433578063744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599648.812911:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874433578063744:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599648.812918:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787599648.812960:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599648.812991:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1874433578063744:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.813335:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578063616:12345-0@lo:400:kworker.0 Request processed in 1010us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599648.813365:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787599648.813438:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578063616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.813654:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578063872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.813753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599648.813918:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433578064000:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.814100:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578064128:0@lo:400:kworker.0 00000100:00100000:1.0:1787599648.814135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599648.816376:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578063872 00000100:00100000:2.0:1787599648.816395:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578063872 00000100:00100000:3.0:1787599648.816477:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064128 00000100:00100000:3.0:1787599648.816482:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064128 00000100:00100000:3.0:1787599648.816521:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787599648.816545:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578063872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599648.816669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599648.816841:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064000 00000100:00100000:0.0:1787599648.816846:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064000 00000100:00100000:0.0:1787599648.816875:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599648.816882:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578064128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599648.817164:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578064128:12345-0@lo:400:kworker.0 Request processed in 279us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599648.817173:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599648.817195:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599648.817203:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433578064000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599648.817239:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874433578064000:12345-0@lo:400:kworker.0 Request processed in 39us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599648.817245:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599648.817293:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1874433578064000:0@lo:400:kworker.0 00000100:00080000:2.0:1787599648.817406:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599648.817430:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787599648.817661:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b34e51d500 x1874433578064128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599648.817675:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578064128:0@lo:400:kworker.0 00000100:00100000:3.0:1787599648.818165:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578063872:12345-0@lo:400:kworker.0 Request processed in 1631us (4467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599648.818176:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1787599648.818286:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b34e51ea00 x1874433578063872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599648.818298:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578063872:0@lo:400:kworker.0 00010000:00010000:2.0:1787599649.254203:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599649.317850:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578064256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599649.317918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599649.318825:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064256 00000100:00100000:3.0:1787599649.318838:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064256 00000100:00100000:3.0:1787599649.318899:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599649.318907:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578064256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599649.318942:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599649.318996:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578064256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599649.319003:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599649.319107:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377afd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578064256:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1787599649.320456:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1787599649.320465:0:17078:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1787599649.320507:0:17137:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1787599649.320518:0:17137:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:1.0:1787599649.321420:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599649.321438:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578064384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599649.321496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599649.321549:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064384 00000100:00100000:1.0:1787599649.321556:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064384 00000100:00100000:1.0:1787599649.321600:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599649.321608:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578064384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599649.321638:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599649.321679:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578064384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599649.321701:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599649.321745:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578064384:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599650.290497:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599650.758954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599650.758988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599650.759019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599650.759068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599650.759092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599650.759122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599650.759293:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113344 00000100:00100000:2.0:1787599650.759304:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113344 00000100:00100000:2.0:1787599650.759365:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113600 00000100:00100000:2.0:1787599650.759369:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113600 00000100:00100000:2.0:1787599650.759385:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113216 00000100:00100000:2.0:1787599650.759388:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113216 00000100:00100000:2.0:1787599650.759401:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113728 00000100:00100000:2.0:1787599650.759415:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113728 00000100:00100000:2.0:1787599650.759434:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1787599650.759444:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2404:x1874433559113344:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599650.759528:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2404:x1874433559113344:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 84us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599650.759537:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 84 00000100:00100000:2.0:1787599650.759555:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1787599650.759561:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2404:x1874433559113600:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599650.759588:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+6:2404:x1874433559113600:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599650.759595:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 85 00000100:00100000:2.0:1787599650.759608:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1787599650.759615:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:2403:x1874433559113216:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599650.759639:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:2403:x1874433559113216:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599650.759646:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 86 00000100:00100000:2.0:1787599650.759657:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:2.0:1787599650.759663:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2403:x1874433559113728:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599650.759698:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd7a1775-f008-45c6-8360-bad6104f0230+5:2403:x1874433559113728:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599650.759705:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 87 00000100:00100000:3.0:1787599650.759884:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113472 00000100:00100000:3.0:1787599650.759889:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113472 00000100:00100000:3.0:1787599650.759936:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1787599650.759950:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2403:x1874433559113472:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:3.0:1787599650.759979:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2403:x1874433559113472:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 31us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599650.759985:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1787599650.760116:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113088 00000100:00100000:1.0:1787599650.760121:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113088 00000100:00100000:1.0:1787599650.760157:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00100000:1.0:1787599650.760164:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:2404:x1874433559113088:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599650.760190:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10394c45-c749-48e8-b612-3d793d59d9ea+13:2404:x1874433559113088:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 28us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599650.760196:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 172 00000100:00080000:0.0:1787599650.760568:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599650.760572:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787599650.760574:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1787599650.981588:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599651.307069:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599651.366706:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000020:00000080:1.0:1787599651.366717:0:18601:0:(genops.c:885:class_export_put()) final put ffff96b34e542000/dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:1.0:1787599651.366748:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000020:00000080:1.0:1787599651.366751:0:18601:0:(genops.c:885:class_export_put()) final put ffff96b244234800/61197e0d-f8b1-498d-a559-d8255f02ecf0 00000020:00000080:3.0:1787599651.366829:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34e542000/dd7a1775-f008-45c6-8360-bad6104f0230 for lustre-OST0000 00000020:00000080:3.0:1787599651.366891:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244234800/61197e0d-f8b1-498d-a559-d8255f02ecf0 for lustre-OST0000 00000020:00000080:3.0:1787599651.366913:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e544800 for lustre-OST0000 00000020:00000080:3.0:1787599651.366918:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244235000 for lustre-OST0000 00000001:00100000:2.0:1787599651.369444:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000020:00000080:2.0:1787599651.369453:0:19420:0:(genops.c:885:class_export_put()) final put ffff96b34e542800/dd7a1775-f008-45c6-8360-bad6104f0230 00000020:00000080:0.0:1787599651.369532:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34e542800/dd7a1775-f008-45c6-8360-bad6104f0230 for lustre-OST0001 00000020:00000080:0.0:1787599651.369580:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e544000 for lustre-OST0001 00000100:00100000:1.0:1787599652.105157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599652.105270:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559113984 00000100:00100000:2.0:1787599652.105279:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559113984 00000100:00100000:2.0:1787599652.105353:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:2.0:1787599652.105364:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+13:16342:x1874433559113984:12345-192.168.202.1@tcp:35:umount.0 00000001:00080000:2.0:1787599652.105690:0:17100:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00080000:0.0:1787599652.106022:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599652.106060:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:16342:x1874433559113984:12345-192.168.202.1@tcp:35:umount.0 Request processed in 696us (912us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1787599652.106069:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000020:00080000:2.0:1787599652.106074:0:17100:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787599652.117634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599652.117837:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559114112 00000100:00100000:2.0:1787599652.117849:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559114112 00000100:00100000:2.0:1787599652.117923:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1787599652.117935:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559114112:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599652.117951:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599652.117974:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54b800/0x5d2988b0929d08e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbeca expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599652.117999:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599652.118078:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+12:2405:x1874433559114112:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 145us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599652.118103:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1787599652.118875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599652.118913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599652.118987:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559114368 00000100:00100000:3.0:1787599652.118993:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559114368 00000100:00100000:3.0:1787599652.119040:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559114240 00000100:00100000:3.0:1787599652.119044:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559114240 00000100:00100000:3.0:1787599652.119068:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599652.119076:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10394c45-c749-48e8-b612-3d793d59d9ea+13:2405:x1874433559114368:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599652.119086:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599652.119098:0:17853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243758800/0x5d2988b0929d09ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb1 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.119111:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599652.119146:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10394c45-c749-48e8-b612-3d793d59d9ea+12:2405:x1874433559114368:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599652.119153:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599652.119217:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1787599652.119223:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10394c45-c749-48e8-b612-3d793d59d9ea+11:2405:x1874433559114240:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599652.119231:0:17853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599652.119240:0:17853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54aa00/0x5d2988b0929d08ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbefb expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.119260:0:17853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599652.119280:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10394c45-c749-48e8-b612-3d793d59d9ea+10:2405:x1874433559114240:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 56us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599652.119287:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:3.0:1787599652.128681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599652.128827:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559114496 00000100:00100000:1.0:1787599652.128840:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559114496 00000100:00100000:1.0:1787599652.128938:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:1.0:1787599652.128951:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2402:x1874433559114496:12345-192.168.202.1@tcp:9:umount.0 00000020:00000080:1.0:1787599652.128993:0:18604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0911 00000100:00080000:1.0:1787599652.129002:0:18604:0:(import.c:65:import_set_state_nolock()) ffff96b34e509800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599652.129052:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787599652.129214:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+2:2402:x1874433559114496:12345-192.168.202.1@tcp:9:umount.0 Request processed in 265us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599652.129222:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00010000:00010000:2.0:1787599652.129444:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599652.129500:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787599652.151990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599652.154259:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559115392 00000100:00100000:2.0:1787599652.154278:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559115392 00000100:00100000:2.0:1787599652.154444:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 67 00000100:00100000:2.0:1787599652.154457:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+15:2402:x1874433559115392:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:2.0:1787599652.154494:0:17097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0903 00000020:00010000:2.0:1787599652.154524:0:17097:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b3434d4000: total 0 00000100:00080000:2.0:1787599652.154530:0:17097:0:(import.c:65:import_set_state_nolock()) ffff96b34e547800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599652.154566:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1787599652.155054:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61197e0d-f8b1-498d-a559-d8255f02ecf0+14:2402:x1874433559115392:12345-192.168.202.1@tcp:39:umount.0 Request processed in 597us (3392us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787599652.155063:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 67 00000020:00010000:3.0:1787599652.156138:0:17086:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b3434d4000: total 0 00010000:00010000:3.0:1787599652.156148:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599652.156209:0:17086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b3434d4000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787599652.156250:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:3.0:1787599652.156255:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599652.156266:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759e00/0x5d2988b0929d0c0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc06e expref: 13 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156292:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b3555d8700) 00010000:00010000:3.0:1787599652.156295:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599652.156299:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d09e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfbf expref: 12 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156320:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:3.0:1787599652.156323:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599652.156327:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d0a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfcd expref: 11 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156357:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff96b3555d8500) 00010000:00010000:3.0:1787599652.156360:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787599652.156364:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d0bb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc04b expref: 10 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156398:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b3555d8d00) 00010000:00010000:3.0:1787599652.156401:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787599652.156405:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d09c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfb8 expref: 9 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156419:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96b378296300) 00010000:00010000:3.0:1787599652.156422:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787599652.156426:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c200/0x5d2988b0929d0aa7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbff7 expref: 8 pid: 18087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156439:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:3.0:1787599652.156441:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787599652.156444:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b000/0x5d2988b0929d0b56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc036 expref: 7 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156456:0:17086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96b242159c00) 00010000:00010000:3.0:1787599652.156458:0:17086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787599652.156462:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3de00/0x5d2988b0929d0b25 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc021 expref: 6 pid: 17099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599652.156476:0:17086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b3434d4000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787599652.156489:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599652.156491:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599652.156493:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599652.168230:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599652.168375:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559115520 00000100:00100000:3.0:1787599652.168386:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559115520 00000100:00100000:3.0:1787599652.168464:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 68 00000100:00100000:3.0:1787599652.168488:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+5:2402:x1874433559115520:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1787599652.168530:0:17098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d08fc 00000100:00080000:3.0:1787599652.168549:0:17098:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599652.168580:0:17098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787599652.168831:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61197e0d-f8b1-498d-a559-d8255f02ecf0+3:2402:x1874433559115520:12345-192.168.202.1@tcp:39:umount.0 Request processed in 343us (610us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787599652.168840:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 68 00010000:00010000:2.0:1787599652.169026:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787599652.169935:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787599652.325242:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599653.157065:0:17133:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599653.157076:0:17133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599653.157097:0:17133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787599653.157107:0:17133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787599653.319664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599653.319714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599653.319744:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599653.319811:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559115648 00000100:00100000:2.0:1787599653.319823:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559115648 00000100:00100000:1.0:1787599653.319869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599653.319876:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559115904 00000100:00100000:2.0:1787599653.319879:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559115904 00000100:00100000:2.0:1787599653.319903:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559115776 00000100:00100000:1.0:1787599653.319905:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116160 00000100:00100000:2.0:1787599653.319906:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559115776 00000100:00100000:1.0:1787599653.319913:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116160 00000100:00100000:2.0:1787599653.319921:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599653.319931:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+12:2406:x1874433559115648:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599653.319943:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599653.319962:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5800/0x5d2988b0929d0926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf3a expref: 12 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599653.319969:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 69 00010000:00010000:2.0:1787599653.319979:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599653.320036:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+11:2406:x1874433559115648:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 108us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599653.320041:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599653.320053:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599653.320057:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+10:2406:x1874433559115904:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599653.320063:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599653.320069:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54ac00/0x5d2988b0929d09a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfaa expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599653.320075:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599653.320085:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+9:2406:x1874433559115904:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599653.320088:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599653.320094:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:2.0:1787599653.320098:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+8:2406:x1874433559115776:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599653.320102:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599653.320106:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5a00/0x5d2988b0929d092d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbf6b expref: 8 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599653.320111:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599653.320119:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10394c45-c749-48e8-b612-3d793d59d9ea+7:2406:x1874433559115776:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599653.320123:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00080000:2.0:1787599653.320156:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599653.320378:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+6:2402:x1874433559116160:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:1.0:1787599653.320414:0:17099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d093b 00000020:00010000:1.0:1787599653.320422:0:17099:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b34e546800: total 0 00000100:00080000:1.0:1787599653.320425:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b34e540800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599653.320456:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1787599653.320614:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd7a1775-f008-45c6-8360-bad6104f0230+5:2402:x1874433559116160:12345-192.168.202.1@tcp:39:umount.0 Request processed in 636us (745us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1787599653.320622:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 69 00000020:00010000:2.0:1787599653.321519:0:17087:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b34e546800: total 0 00010000:00010000:2.0:1787599653.321569:0:17087:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b34e546800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787599653.321603:0:17087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b342bf1f00) 00010000:00010000:2.0:1787599653.321615:0:17087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599653.321624:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b2440e4c00/0x5d2988b0929d0a30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbfd4 expref: 4 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599653.321896:0:17087:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b34e546800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787599653.321912:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599653.321915:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599653.321917:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599653.335104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599653.335259:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116288 00000100:00100000:3.0:1787599653.335270:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116288 00000100:00100000:3.0:1787599653.335351:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00100000:3.0:1787599653.335361:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+5:2402:x1874433559116288:12345-192.168.202.1@tcp:39:umount.0 00000020:00000080:3.0:1787599653.335408:0:17098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0942 00000100:00080000:3.0:1787599653.335418:0:17098:0:(import.c:65:import_set_state_nolock()) ffff96b34e545000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599653.335456:0:17098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787599653.335620:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd7a1775-f008-45c6-8360-bad6104f0230+3:2402:x1874433559116288:12345-192.168.202.1@tcp:39:umount.0 Request processed in 260us (525us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787599653.335629:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 70 00000100:00080000:2.0:1787599653.335826:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787599653.335949:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599653.350211:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599653.372924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599653.373263:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116544 00000100:00100000:3.0:1787599653.373276:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116544 00000100:00100000:3.0:1787599653.373774:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 173 00000100:00100000:3.0:1787599653.373787:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+7:2402:x1874433559116544:12345-192.168.202.1@tcp:251:umount.0 00000020:00000080:3.0:1787599653.373895:0:17090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d08d9 00000020:00010000:3.0:1787599653.373903:0:17090:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b244236000: total 0 00000100:00080000:3.0:1787599653.373907:0:17090:0:(import.c:65:import_set_state_nolock()) ffff96b244235800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787599653.374052:0:17086:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b244236000: total 0 00010000:00010000:0.0:1787599653.374056:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599653.374103:0:17086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b244236000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787599653.374133:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e4000/0x5d2988b0929d08e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adbec3 expref: 3 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599653.374148:0:17086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b244236000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787599653.374155:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599653.374157:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599653.374168:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599653.374265:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:10394c45-c749-48e8-b612-3d793d59d9ea+1:2402:x1874433559116544:12345-192.168.202.1@tcp:251:umount.0 Request processed in 482us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599653.374280:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 173 00000020:00000080:3.0:1787599653.374289:0:17090:0:(genops.c:885:class_export_put()) final put ffff96b244236000/10394c45-c749-48e8-b612-3d793d59d9ea 00000020:00000080:0.0:1787599653.374345:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244236000/10394c45-c749-48e8-b612-3d793d59d9ea for MGS 00000020:00000080:0.0:1787599653.374376:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244235800 for MGS 00000100:00100000:1.0:1787599653.413385:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599653.413459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599653.413616:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064512 00000100:00100000:3.0:1787599653.413625:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064512 00000100:00100000:3.0:1787599653.413703:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599653.413715:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578064512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599653.413744:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1787599653.418757:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599653.426774:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578064512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13046us (13299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599653.426806:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599653.440627:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578064512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599653.926468:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578064896:0@lo:400:kworker.0 00000100:00100000:0.0:1787599653.926550:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599653.926595:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578065408:0@lo:400:kworker.0 00000100:00100000:0.0:1787599653.926613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599653.926634:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578065920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.926732:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578064640:0@lo:400:kworker.0 00000100:00100000:0.0:1787599653.929715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.930351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.930400:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578065152:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.930432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.930452:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578065664:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.930501:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578065024:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.930536:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064640 00000100:00100000:1.0:1787599653.930544:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064640 00000100:00100000:1.0:1787599653.930591:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787599653.930601:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3647:x1874433578064640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.930664:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3647:x1874433578064640:12345-0@lo:400:kworker.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.930671:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787599653.930706:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065152 00000100:00100000:1.0:1787599653.930709:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065152 00000100:00100000:1.0:1787599653.930736:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787599653.930743:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578065152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.930812:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578065152:12345-0@lo:400:kworker.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.930819:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599653.931152:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065920 00000100:00100000:0.0:1787599653.931157:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065920 00000100:00100000:0.0:1787599653.931196:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787599653.931204:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578065920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599653.931242:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578065920:12345-0@lo:400:kworker.0 Request processed in 39us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599653.931248:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787599653.931266:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599653.931293:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578065920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.931507:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578065536:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.931549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578066048:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.931616:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065024 00000100:00100000:1.0:1787599653.931620:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065024 00000100:00100000:1.0:1787599653.931641:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065536 00000100:00100000:1.0:1787599653.931644:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065536 00000100:00100000:1.0:1787599653.931668:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066048 00000100:00100000:1.0:1787599653.931671:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066048 00000100:00100000:1.0:1787599653.931692:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599653.931698:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578065024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931732:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578065024:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.931739:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599653.931751:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599653.931757:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578065536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931784:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578065536:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.931816:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787599653.931839:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599653.931846:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578066048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931883:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578066048:12345-0@lo:400:kworker.0 Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.931896:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787599653.931914:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599653.931934:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578065024:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931944:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578065536:0@lo:400:kworker.0 00010000:00080000:1.0:1787599653.931955:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433578066048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599653.931966:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578066048:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.931991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.932176:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578064640:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932187:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578065152:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932197:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787599653.932204:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578064768:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.932262:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578065280:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.932301:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578065792:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.932344:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064896 00000100:00100000:1.0:1787599653.932348:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064896 00000100:00100000:1.0:1787599653.932379:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065408 00000100:00100000:1.0:1787599653.932382:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065408 00000100:00100000:1.0:1787599653.932395:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065280 00000100:00100000:1.0:1787599653.932403:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065280 00000100:00100000:1.0:1787599653.932421:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599653.932427:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578064896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932479:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578064896:12345-0@lo:400:kworker.0 Request processed in 52us (5930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.932503:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599653.932516:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599653.932523:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578065408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932551:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578065408:12345-0@lo:400:kworker.0 Request processed in 29us (5937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.932557:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787599653.932568:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599653.932575:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578065280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.932604:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578065280:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.932610:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599653.932630:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065664 00000100:00100000:1.0:1787599653.932633:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065664 00000100:00100000:1.0:1787599653.933111:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578065792 00000100:00100000:1.0:1787599653.933115:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578065792 00000100:00100000:1.0:1787599653.933135:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599653.933141:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578065664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933175:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578065664:12345-0@lo:400:kworker.0 Request processed in 34us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.933181:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787599653.933193:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787599653.933199:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578065792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933234:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578065792:12345-0@lo:400:kworker.0 Request processed in 36us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.933240:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787599653.933255:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599653.933258:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787599653.933261:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599653.933263:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599653.933275:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578064768 00000100:00100000:1.0:1787599653.933279:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578064768 00000100:00100000:1.0:1787599653.933301:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599653.933307:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578064768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933338:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578064768:12345-0@lo:400:kworker.0 Request processed in 31us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.933344:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787599653.933380:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578064896:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578065408:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933418:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578064768:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933428:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578065280:0@lo:400:kworker.0 00010000:00080000:1.0:1787599653.933587:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1880 x1874433578065792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599653.933600:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578065792:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.933615:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578065664:0@lo:400:kworker.0 00000100:00100000:1.0:1787599653.936920:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578066176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599653.936988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.937033:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599653.937039:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578066304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599653.937061:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599653.937096:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066176 00000100:00100000:1.0:1787599653.937102:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066176 00000100:00100000:1.0:1787599653.937136:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599653.937144:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578066176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599653.937173:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787599653.937210:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578066176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599653.937217:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787599653.937254:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578066176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599653.939833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578066432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599653.939882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599653.940023:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066304 00000100:00100000:2.0:1787599653.940030:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066304 00000100:00100000:2.0:1787599653.940064:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066432 00000100:00100000:2.0:1787599653.940067:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066432 00000100:00100000:2.0:1787599653.940079:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599653.940088:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578066304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599653.940114:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599653.940166:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578066304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599653.940173:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599653.940189:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599653.940195:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578066432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599653.940204:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787599653.940268:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578066304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599653.948639:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578066432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8436us (8749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599653.948662:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599653.949821:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578066432:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787599654.387562:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599654.438461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578066560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599654.438544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599654.438598:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066560 00000100:00100000:3.0:1787599654.438605:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066560 00000100:00100000:3.0:1787599654.438657:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599654.438666:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578066560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599654.438687:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599654.438746:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578066560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599654.438753:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599654.438821:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578066560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599654.442154:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599654.442175:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578066688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599654.442240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599654.442282:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066688 00000100:00100000:3.0:1787599654.442295:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066688 00000100:00100000:3.0:1787599654.442337:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599654.442345:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578066688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599654.442378:0:17103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599654.442420:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578066688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599654.442427:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599654.442470:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578066688:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1787599655.239899:0:20669:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787599655.258257:0:20669:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787599655.258323:0:20669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.258337:0:20669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.258344:0:20669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.258351:0:20669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.258374:0:20669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787599655.258379:0:20669:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787599655.258401:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599655.258405:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787599655.258411:0:20669:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599655.258434:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b3778e6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787599655.258528:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578066816:0@lo:39:umount.0 00000100:00100000:1.0:1787599655.258595:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599655.258682:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066816 00000100:00100000:2.0:1787599655.258690:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066816 00000100:00100000:2.0:1787599655.258740:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599655.258751:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874433578066816:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787599655.258777:0:17099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d04cd 00000100:00080000:2.0:1787599655.258785:0:17099:0:(import.c:65:import_set_state_nolock()) ffff96b2434d6000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787599655.259208:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599655.259216:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259224:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599655.259228:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259244:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599655.259252:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599655.259258:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599655.259260:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787599655.259263:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787599655.259286:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259293:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599655.259311:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259318:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d000/0x5d2988b0929d049c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04a3 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259328:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599655.259330:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599655.259331:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599655.259341:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578066944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.259370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599655.259411:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578066944 00000100:00100000:0.0:1787599655.259414:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578066944 00000100:00100000:0.0:1787599655.259443:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599655.259449:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3648:x1874433578066944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599655.259459:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599655.259489:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c600/0x5d2988b0929d04a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d049c expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.259500:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599655.259528:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:3648:x1874433578066944:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.259535:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599655.259567:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578066944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599655.259613:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1874433578066816:12345-0@lo:39:umount.0 Request processed in 864us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599655.259620:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1787599655.259626:0:17099:0:(genops.c:885:class_export_put()) final put ffff96b2434d4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787599655.259679:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787599655.259747:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787599655.260018:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2434d6000 for lustre-MDT0000 00000100:00080000:3.0:1787599655.261527:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3778e6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787599655.261544:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578066816:0@lo:39:umount.0 00000100:00080000:2.0:1787599655.261601:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599655.261615:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787599655.261618:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787599655.262758:0:20669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262772:0:20669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262779:0:20669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262786:0:20669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262830:0:20669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599655.262837:0:20669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262844:0:20669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262851:0:20669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262857:0:20669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262871:0:20669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787599655.262878:0:20669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262896:0:20669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262902:0:20669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262908:0:20669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262915:0:20669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787599655.262920:0:20669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262926:0:20669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262931:0:20669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262938:0:20669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599655.262945:0:20669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787599655.262948:0:20669:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787599655.262975:0:20669:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787599655.262980:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787599655.262984:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599655.262990:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787599655.262996:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b241a5b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599655.263009:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b36571a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599655.263015:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b3434d0800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599655.263020:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96b34670f800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599655.263028:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff96b34e546800 dd7a1775-f008-45c6-8360-bad6104f0230 192.168.202.1@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1787599655.263033:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff96b3434d4000 61197e0d-f8b1-498d-a559-d8255f02ecf0 192.168.202.1@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1787599655.263038:0:20669:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff96b37077b370) has exports, disconnecting them 00000020:00080000:2.0:1787599655.263043:0:20669:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b241a5b000), last request at 1787599653 00000020:00000080:2.0:1787599655.263049:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d07c8 00010000:00010000:0.0:1787599655.263161:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787599655.263167:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263175:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599655.263178:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263186:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599655.263193:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599655.263199:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599655.263202:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1787599655.263204:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1787599655.263236:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263252:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599655.263276:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263283:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243758e00/0x5d2988b0929d03ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263297:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787599655.263300:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263305:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599655.263309:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263315:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599655.263322:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599655.263328:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599655.263330:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787599655.263332:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787599655.263345:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263352:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599655.263370:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263388:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200c000/0x5d2988b0929d07f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0800 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263398:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599655.263401:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263407:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599655.263410:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263417:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599655.263423:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599655.263428:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787599655.263431:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787599655.263432:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787599655.263447:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263453:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599655.263467:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263483:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d099d expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263504:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599655.263507:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263512:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599655.263515:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263521:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599655.263527:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599655.263531:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599655.263533:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787599655.263535:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787599655.263549:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263555:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599655.263561:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263569:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243759200/0x5d2988b0929d03df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d03e6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263577:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599655.263579:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599655.263586:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599655.263603:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578067072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.263662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599655.263706:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599655.263712:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578067200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.263738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599655.263768:0:20126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067072 00000100:00100000:0.0:1787599655.263774:0:20126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067072 00000100:00100000:0.0:1787599655.263830:0:20126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067200 00000100:00100000:0.0:1787599655.263834:0:20126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067200 00000100:00100000:0.0:1787599655.263857:0:20126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599655.263866:0:20126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+24:3645:x1874433578067072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599655.263877:0:20126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599655.263890:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152b400/0x5d2988b0929d03f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d03ed expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263902:0:20126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599655.263934:0:20126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+23:3645:x1874433578067072:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.263941:0:20126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599655.263958:0:20126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599655.263964:0:20126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3645:x1874433578067200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599655.263971:0:20126:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599655.263980:0:20126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d07f9 expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.263988:0:20126:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599655.264010:0:20126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3645:x1874433578067200:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.264021:0:20126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599655.264088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578067328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.264113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599655.264136:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599655.264142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578067456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.264164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599655.264188:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067328 00000100:00100000:0.0:1787599655.264192:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067328 00000100:00100000:0.0:1787599655.264214:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067456 00000100:00100000:0.0:1787599655.264217:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067456 00000100:00100000:0.0:1787599655.264236:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599655.264242:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+22:3647:x1874433578067328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599655.264250:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599655.264259:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243759800/0x5d2988b0929d099d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d0996 expref: 22 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.264268:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599655.264294:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+21:3647:x1874433578067328:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.264300:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599655.264312:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599655.264319:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+20:3647:x1874433578067456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599655.264325:0:17084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599655.264334:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152ac00/0x5d2988b0929d03e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d03df expref: 20 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599655.264342:0:17084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599655.264372:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3647:x1874433578067456:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.264378:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599655.264413:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578067456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.264422:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578067328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.264449:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578067200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599655.264458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578067072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599655.264646:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599655.264996:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b241a59000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787599655.265050:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b241a5b000): rc 0 00000020:00000080:2.0:1787599655.265053:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b241a5b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787599655.265216:0:20669:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b36571a800), last request at 1787599653 00000020:00000080:2.0:1787599655.265222:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d066a 00000100:00080000:2.0:1787599655.265228:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b36571c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787599655.265245:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b36571a800): rc 0 00000020:00000080:2.0:1787599655.265248:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b36571a800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787599655.265281:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599655.265395:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787599655.265679:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b241a5b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787599655.265737:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b241a59000 for lustre-MDT0000 00000020:00080000:2.0:1787599655.266147:0:20669:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b3434d0800), last request at 1787599577 00000020:00000080:2.0:1787599655.266152:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d05bb 00000100:00080000:2.0:1787599655.266157:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b3434d3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787599655.266175:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b3434d0800): rc 0 00000020:00000080:2.0:1787599655.266177:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b3434d0800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1787599655.266205:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599655.267627:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b36571a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787599655.267672:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b36571c000 for lustre-MDT0000 00000020:00000080:1.0:1787599655.268130:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787599655.268170:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d3000 for lustre-MDT0000 00000020:00080000:2.0:1787599655.268270:0:20669:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96b34670f800), last request at 1787599577 00000020:00000080:2.0:1787599655.268279:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0560 00000100:00080000:2.0:1787599655.268286:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b242df8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599655.268307:0:20669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:0.0:1787599655.268428:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787599655.268523:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b34670f800): rc 0 00000004:00000080:2.0:1787599655.268529:0:20669:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb1448313ae0 00000100:00080000:2.0:1787599655.268548:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787599655.268552:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787599655.269525:0:20669:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787599655.269552:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787599655.269617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067584:0@lo:39:umount.0 00000100:00100000:3.0:1787599655.269687:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599655.269808:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067584 00000100:00100000:1.0:1787599655.269816:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067584 00000100:00100000:1.0:1787599655.269868:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787599655.269880:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578067584:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787599655.269907:0:17103:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d05e5 00000100:00080000:1.0:1787599655.269913:0:17103:0:(import.c:65:import_set_state_nolock()) ffff96b3440de000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787599655.269931:0:17103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1787599655.270373:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787599655.270377:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1787599655.270392:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787599655.270448:0:20669:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787599655.270461:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787599655.270639:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067712:0@lo:9:umount.0 00000100:00100000:3.0:1787599655.270671:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599655.271854:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1874433578067584:12345-0@lo:39:umount.0 Request processed in 1971us (2162us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787599655.271865:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1787599655.271898:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599655.272236:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067712 00000100:00100000:0.0:1787599655.272244:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067712 00000100:00100000:0.0:1787599655.272304:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599655.272314:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578067712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787599655.272333:0:18604:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d06b0 00000100:00080000:0.0:1787599655.272340:0:18604:0:(import.c:65:import_set_state_nolock()) ffff96b37b7a6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787599655.272384:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787599655.272524:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1874433578067712:12345-0@lo:9:umount.0 Request processed in 211us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599655.272532:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787599655.272556:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599655.272650:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599655.272753:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787599655.272757:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1787599655.272776:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787599655.272850:0:20669:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787599655.272868:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787599655.272914:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96b37077b370) has no exports 00000100:00080000:3.0:1787599655.273601:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787599655.273609:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067584:0@lo:39:umount.0 00000100:00100000:3.0:1787599655.273624:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067840:0@lo:9:umount.0 00000100:00100000:3.0:1787599655.273676:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599655.273715:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244394800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599655.273732:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599655.273734:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599655.273744:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067712:0@lo:9:umount.0 00000100:00100000:2.0:1787599655.273863:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067840 00000100:00100000:2.0:1787599655.273868:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067840 00000100:00100000:2.0:1787599655.273913:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599655.273921:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1874433578067840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787599655.273937:0:18606:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0807 00000100:00080000:2.0:1787599655.273943:0:18606:0:(import.c:65:import_set_state_nolock()) ffff96b34de1e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787599655.273974:0:18606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:1.0:1787599655.274138:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787599655.274146:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599655.274218:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3644:x1874433578067840:12345-0@lo:9:umount.0 Request processed in 297us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599655.274225:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787599655.280742:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599655.280767:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599655.280770:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599655.280776:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578067840:0@lo:9:umount.0 00000020:00080000:2.0:1787599655.294215:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff96b37077b370) has no exports 00000020:00000080:2.0:1787599655.376700:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d043a 00000020:00000080:2.0:1787599655.376716:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b2430bc800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787599655.376746:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787599655.377048:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2430bc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787599655.377070:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599655.377080:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787599655.377085:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff96b3706f4d28) has no exports 00000020:00000080:3.0:1787599655.377436:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0433 00000020:00000080:3.0:1787599655.377442:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b351f6b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787599655.377510:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599655.377517:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787599655.377520:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b351f6d000/lustre-QMT0000_UUID 00000020:00000080:3.0:1787599655.377523:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b351f6d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787599655.377528:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787599655.377690:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b351f6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787599655.396972:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599656.425745:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599657.445867:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599658.471477:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787599658.535426:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599658.535435:0:17078:0:(genops.c:885:class_export_put()) final put ffff96b34670f800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787599658.535694:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00080000:3.0:1787599658.535702:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787599658.535705:0:17078:0:(genops.c:885:class_export_put()) final put ffff96b34e546800/dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:0.0:1787599658.540425:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787599658.540440:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787599658.540456:0:17830:0:(genops.c:885:class_export_put()) final put ffff96b3440d9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599658.545088:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34670f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787599658.545151:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b242df8800 for lustre-MDT0000 00000001:00100000:2.0:1787599658.546865:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599658.546873:0:19420:0:(genops.c:885:class_export_put()) final put ffff96b34de1b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787599658.552557:0:17078:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000001:00080000:3.0:1787599658.552571:0:17078:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1787599658.552582:0:17078:0:(genops.c:885:class_export_put()) final put ffff96b3434d4000/61197e0d-f8b1-498d-a559-d8255f02ecf0 00000001:00100000:0.0:1787599658.552936:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00080000:0.0:1787599658.552944:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787599658.552947:0:17830:0:(genops.c:885:class_export_put()) final put ffff96b34e547000/dd7a1775-f008-45c6-8360-bad6104f0230 00000001:00100000:0.0:1787599658.552952:0:17830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000001:00080000:0.0:1787599658.552955:0:17830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787599658.552957:0:17830:0:(genops.c:885:class_export_put()) final put ffff96b347dcc000/61197e0d-f8b1-498d-a559-d8255f02ecf0 00000020:00000080:1.0:1787599658.554181:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34e546800/dd7a1775-f008-45c6-8360-bad6104f0230 for lustre-MDT0000 00000020:00000080:1.0:1787599658.554286:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d4000/61197e0d-f8b1-498d-a559-d8255f02ecf0 for lustre-MDT0000 00000020:00000080:1.0:1787599658.554313:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3440d9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787599658.554343:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34e547000/dd7a1775-f008-45c6-8360-bad6104f0230 for lustre-MDT0001 00000020:00000080:1.0:1787599658.554360:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b347dcc000/61197e0d-f8b1-498d-a559-d8255f02ecf0 for lustre-MDT0001 00000020:00000080:1.0:1787599658.554375:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e540800 for lustre-MDT0000 00000020:00000080:1.0:1787599658.554379:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e547800 for lustre-MDT0000 00000020:00000080:1.0:1787599658.554383:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3440de000 for lustre-MDT0001 00000020:00000080:1.0:1787599658.554388:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e545000 for lustre-MDT0001 00000020:00000080:1.0:1787599658.554391:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d7800 for lustre-MDT0001 00000001:00100000:2.0:1787599658.556329:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 61197e0d-f8b1-498d-a559-d8255f02ecf0 00000020:00000080:2.0:1787599658.556340:0:19420:0:(genops.c:885:class_export_put()) final put ffff96b244237000/61197e0d-f8b1-498d-a559-d8255f02ecf0 00000020:00000080:0.0:1787599658.556427:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34de1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787599658.556481:0:13886:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244237000/61197e0d-f8b1-498d-a559-d8255f02ecf0 for lustre-OST0001 00000020:00000080:0.0:1787599658.556497:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34de1e800 for lustre-OST0001 00000020:00000080:0.0:1787599658.556501:0:13886:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34e509800 for lustre-OST0001 00000100:00100000:0.0:1787599659.045080:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599659.045102:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578067968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599659.045168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599659.045218:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578067968 00000100:00100000:0.0:1787599659.045225:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578067968 00000100:00100000:0.0:1787599659.045281:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599659.045290:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578067968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599659.045319:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787599659.045356:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578067968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599659.045363:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599659.045404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578067968:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787599659.045488:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599659.045755:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578068096:0@lo:400:kworker.0 00000100:00100000:1.0:1787599659.045786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599659.046018:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068096 00000100:00100000:0.0:1787599659.046024:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068096 00000100:00100000:3.0:1787599659.046047:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578068224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599659.046060:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787599659.046069:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3646:x1874433578068096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599659.046107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599659.046165:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068224 00000100:00100000:3.0:1787599659.046170:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068224 00000100:00100000:3.0:1787599659.046195:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787599659.046214:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1874433578068224:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1787599659.046221:0:17103:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787599659.046251:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1874433578068224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 37us (144us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787599659.046258:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:3.0:1787599659.046283:0:3647:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1787599659.051695:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0656b88f-dbfb-4f1b-a90c-8b5223ca997d+19:3646:x1874433578068096:12345-0@lo:400:kworker.0 Request processed in 5614us (5894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599659.051731:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787599659.051826:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578068352:0@lo:400:kworker.0 00000100:00100000:0.0:1787599659.051887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599659.051945:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068352 00000100:00100000:0.0:1787599659.051953:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068352 00000100:00100000:0.0:1787599659.052006:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599659.052015:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578068352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599659.052265:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578068352:12345-0@lo:400:kworker.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599659.052272:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787599659.052315:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578068352:0@lo:400:kworker.0 00000100:00100000:0.0:1787599659.052356:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578068480:0@lo:400:kworker.0 00000100:00100000:0.0:1787599659.052384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787599659.052420:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599659.052436:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068480 00000100:00100000:0.0:1787599659.052439:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068480 00000100:00080000:3.0:1787599659.052871:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787599659.052878:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787599659.052882:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787599659.053156:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599659.053162:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1874433578068480:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787599659.053168:0:18087:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787599659.053202:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1874433578068480:12345-0@lo:400:kworker.0 Request processed in 39us (817us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787599659.053208:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787599659.053236:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787599659.053240:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787599659.053243:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787599659.053259:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787599659.053263:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:0.0:1787599659.053269:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b3434d7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599659.053295:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433e0380 x1874433578068608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599659.053316:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578068480:0@lo:400:kworker.0 00000100:00100000:0.0:1787599659.053346:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578068608:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787599659.053370:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599659.053401:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068608 00000100:00100000:0.0:1787599659.053405:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068608 00000100:00100000:0.0:1787599659.053432:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787599659.053437:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578068608:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787599659.053465:0:17097:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787599659.053582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578068992:0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.053622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.053642:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599659.053646:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578068864:0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.053663:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.053749:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068992 00000100:00100000:2.0:1787599659.053753:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068992 00000100:00100000:2.0:1787599659.053767:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068864 00000100:00100000:2.0:1787599659.053770:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068864 00000100:00100000:2.0:1787599659.053788:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599659.053807:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578068864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.053839:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578068864:12345-0@lo:400:kworker.0 Request processed in 33us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599659.053844:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599659.053856:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599659.053859:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874433578068992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787599659.053864:0:18087:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787599659.053882:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1874433578068992:12345-0@lo:400:kworker.0 Request processed in 21us (259us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599659.053887:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1787599659.053908:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ac000 x1874433578068864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599659.053925:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578068864:0@lo:400:kworker.0 00000100:00080000:2.0:1787599659.053933:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787599659.053936:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787599659.053940:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787599659.053943:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599659.053946:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1787599659.053950:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b347dc9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599659.053964:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ac700 x1874433578069248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599659.053978:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578068992:0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.054002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578069120:0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.054022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.054035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599659.054040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578068736:0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.054055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.054084:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069120 00000100:00100000:2.0:1787599659.054088:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069120 00000100:00100000:2.0:1787599659.054106:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578068736 00000100:00100000:2.0:1787599659.054108:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578068736 00000100:00100000:2.0:1787599659.054116:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787599659.054121:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578069120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599659.054149:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578069120:12345-0@lo:400:kworker.0 Request processed in 28us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599659.054174:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787599659.054185:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599659.054189:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1874433578068736:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787599659.054193:0:17099:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787599659.054213:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1874433578068736:12345-0@lo:400:kworker.0 Request processed in 23us (157us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599659.054218:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787599659.054240:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787599659.054243:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787599659.054246:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787599659.054249:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599659.054252:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 542 00000100:00080000:2.0:1787599659.054256:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b3434d6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599659.054268:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ad180 x1874433578069376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599659.054277:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578068736:0@lo:400:kworker.0 00010000:00080000:2.0:1787599659.054287:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ae300 x1874433578069120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599659.054297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578069120:0@lo:400:kworker.0 00000100:00080000:2.0:1787599659.054318:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599659.063260:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3646:1874433578068096:0@lo:400:kworker.0 00000100:00100000:1.0:1787599659.063360:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578069248:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787599659.063432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599659.063474:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578069376:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787599659.063494:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.063698:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069248 00000100:00100000:2.0:1787599659.063707:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069248 00000100:00100000:2.0:1787599659.063745:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069376 00000100:00100000:2.0:1787599659.063748:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069376 00000100:00100000:2.0:1787599659.063779:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599659.063786:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578069248:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787599659.063826:0:17099:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787599659.063870:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578069248:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 84us (438us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599659.063878:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599659.063892:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787599659.063896:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578069376:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787599659.063903:0:17099:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787599659.063924:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578069376:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 27us (429us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599659.063929:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787599659.065707:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599659.065718:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599659.065722:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578069248:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1787599659.065731:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599659.065735:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599659.065738:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578069376:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787599659.067470:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599659.067477:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1787599659.067486:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b2437f2000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599659.067782:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ae300 x1874433578069504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599659.083163:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578069504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787599659.083249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599659.083392:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069504 00000100:00100000:2.0:1787599659.083400:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069504 00000100:00100000:2.0:1787599659.083456:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787599659.083464:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578069504:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787599659.083481:0:17103:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787599659.083535:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578069504:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 70us (285us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599659.083541:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787599659.083941:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599659.083948:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599659.083952:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578069504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787599659.086496:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578068608:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 33049us (33116us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599659.086510:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787599659.089126:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599659.089138:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599659.089143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578068608:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787599659.492975:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599659.557116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578069632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599659.557189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599659.557222:0:18608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069632 00000100:00100000:0.0:1787599659.557232:0:18608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069632 00000100:00100000:0.0:1787599659.557280:0:18608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599659.557288:0:18608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578069632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599659.557325:0:18608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599659.557388:0:18608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578069632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599659.557396:0:18608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787599659.557444:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578069632:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787599660.198526:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599660.517053:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599661.097923:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599661.097939:0:18601:0:(genops.c:885:class_export_put()) final put ffff96b37b7a3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787599661.099630:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37b7a3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787599661.099750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b37b7a6800 for lustre-OST0000 00000020:01000000:3.0:1787599661.412979:0:20669:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242114780 - data ffff96b359738d80/ffff96b34e5a3400 00000020:01000000:3.0:1787599661.413197:0:20669:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b34dce93c0 - data ffff96b3421f7ca8/ffff96b37b648000 00000001:00000004:3.0:1787599661.422699:0:20669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:1.0:1787599661.514831:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599661.514842:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787599661.514859:0:20669:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff96b37fa05f80 x1874433578067584/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787599665 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599661.514910:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787599661.519955:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787599661.519966:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1787599661.519985:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599661.519988:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787599661.523716:0:17121:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787599661.523724:0:17121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1787599661.523753:0:17121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1787599661.524505:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787599661.524510:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1787599661.524530:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787599661.524534:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787599661.526661:0:17123:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787599661.526668:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1787599661.526679:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787599661.538517:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0402 00000020:00000080:1.0:1787599661.538529:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b358d51800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787599661.542136:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0417 00000020:00000080:1.0:1787599661.542153:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b378284000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.542205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b358d51800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787599661.543115:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787599661.543125:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599661.543134:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599661.543140:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff96b37077cd28) has no exports 00000004:01000000:1.0:1787599661.543364:0:20669:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787599661.543374:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0479 00000020:00000080:1.0:1787599661.543379:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b38112c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.543854:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378284000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787599661.543988:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787599661.543993:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599661.544000:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787599661.544003:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff96b3706f0000) has no exports 00000020:00000080:1.0:1787599661.544010:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0472 00000020:00000080:1.0:1787599661.544015:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b34631d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787599661.544247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b38112c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787599661.545282:0:20669:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787599661.545288:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599661.545293:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1787599661.545301:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599661.545303:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599661.545352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34631d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787599661.545534:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599661.545543:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787599661.545550:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0464 00000020:00000080:0.0:1787599661.545559:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b34631b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.545956:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3707b7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787599661.545965:0:38:0:(genops.c:885:class_export_put()) final put ffff96b34631e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.545967:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34631e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787599661.545978:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787599661.546140:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787599661.546146:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599661.546151:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599661.546156:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff96b3707bb370) has no exports 00000020:00000080:0.0:1787599661.546162:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d045d 00000020:00000080:0.0:1787599661.546166:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b244390800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787599661.546497:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34631b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1787599661.554321:0:20669:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787599661.554331:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599661.554336:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1787599661.554347:0:20669:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599661.554349:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599661.558579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244390800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787599661.559343:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599661.559358:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787599661.559375:0:20669:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787599661.559385:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d044f 00000020:00000080:0.0:1787599661.559394:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b358d50000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787599661.559400:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787599661.559409:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599661.559414:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599661.559418:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff96b3706f19b8) has no exports 00000020:00000080:0.0:1787599661.559464:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0448 00000020:00000080:0.0:1787599661.559469:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b3707b2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787599661.559901:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244394800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787599661.559912:0:38:0:(genops.c:885:class_export_put()) final put ffff96b358d55000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.559915:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b358d55000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787599661.559920:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599661.560015:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b358d50000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787599661.560020:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3707b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787599661.562440:0:20669:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787599661.562450:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599661.562454:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787599661.562462:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599661.562507:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599661.562529:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599661.562560:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599661.562564:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599661.562569:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b3778e0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787599661.562573:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3778e0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787599661.562585:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787599661.562679:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d041e 00000020:00000080:1.0:1787599661.562686:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b378287000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787599661.562691:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787599661.562694:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599661.562698:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599661.562702:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff96b3707b8000) has no exports 00000020:00000080:1.0:1787599661.562720:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599661.562723:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787599661.562726:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0425 00000020:00000080:1.0:1787599661.562729:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b378283800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787599661.562737:0:20669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b377a86000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787599661.562740:0:20669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b377a86000 3 00000020:01000004:1.0:1787599661.562742:0:20669:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b377a86000 from lustre-MDT0000 00000020:00000080:1.0:1787599661.562757:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599661.562759:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787599661.562762:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b358d57000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787599661.562764:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b358d57000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787599661.562770:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787599661.562836:0:20669:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787599661.562840:0:20669:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787599661.562843:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787599661.562845:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599661.562847:0:20669:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599661.562854:0:20669:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff96b24411c800 0656b88f-dbfb-4f1b-a90c-8b5223ca997d 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599661.562859:0:20669:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff96b37f89b370) has exports, disconnecting them 00000020:00080000:1.0:1787599661.562863:0:20669:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96b24411c800), last request at 1787599561 00000020:00000080:1.0:1787599661.562880:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d03ca 00000020:00010000:1.0:1787599661.562883:0:20669:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96b24411c800: total 2 00000100:00080000:1.0:1787599661.562887:0:20669:0:(import.c:65:import_set_state_nolock()) ffff96b24411a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787599661.562898:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b24411c800): rc 0 00000020:00080000:1.0:1787599661.562902:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff96b37f89b370) has no exports 00000100:00100000:1.0:1787599661.562956:0:17092:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff96b34de2ac00:17092] 2 exiting: rc = 0 00000020:00010000:1.0:1787599661.563041:0:17086:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96b24411c800: total 2 00010000:00010000:1.0:1787599661.563063:0:17086:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96b24411c800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787599661.563096:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5c00/0x5d2988b0929d0505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d04fe expref: 14 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563110:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d098f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d0988 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563122:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243758400/0x5d2988b0929d0789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d0782 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563132:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d062b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d0624 expref: 11 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563141:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3c000/0x5d2988b0929d07b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d07ac expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563151:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152a400/0x5d2988b0929d03d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d03d1 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563160:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d07f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d07eb expref: 8 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563173:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5e00/0x5d2988b0929d0973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d096c expref: 7 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563197:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b34152ae00/0x5d2988b0929d04e9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d04e2 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563210:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b243758200/0x5d2988b0929d0655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d064e expref: 5 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563220:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5200/0x5d2988b0929d0981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d097a expref: 4 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563230:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c400/0x5d2988b0929d05a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d059f expref: 3 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563241:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b2440e5400/0x5d2988b0929d04f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d2988b0929d04f0 expref: 2 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599661.563251:0:17086:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96b24411c800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787599661.563266:0:17086:0:(genops.c:885:class_export_put()) final put ffff96b24411c800/0656b88f-dbfb-4f1b-a90c-8b5223ca997d 00010000:00010000:1.0:1787599661.563274:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599661.563276:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599661.563278:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599661.563311:0:17090:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96b34de2aa00:17090] 0 exiting: rc = 1 00000020:00000080:2.0:1787599661.563573:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3707b2800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787599661.563582:0:38:0:(genops.c:885:class_export_put()) final put ffff96b3707b0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787599661.563584:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3707b0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787599661.563594:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599661.563648:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378287000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787599661.563652:0:38:0:(genops.c:885:class_export_put()) final put ffff96b358d51000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787599661.563654:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b358d51000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787599661.563658:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787599661.563682:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b378283800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787599661.563687:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24411c800/0656b88f-dbfb-4f1b-a90c-8b5223ca997d for MGS 00000020:00000080:2.0:1787599661.563727:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b24411a800 for MGS 00000100:00100000:2.0:1787599661.563852:0:17091:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff96b349a5e600:17091] 1 exiting: rc = 0 00000100:00100000:1.0:1787599661.564008:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564017:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564023:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564029:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564034:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564041:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564049:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564056:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564063:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564078:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564084:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564090:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564096:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564101:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564107:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564113:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564119:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564125:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564130:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564136:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564142:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564147:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564153:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564158:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564163:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564169:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564174:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564180:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564186:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564192:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564198:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564204:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564210:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564216:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564221:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564228:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564233:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564238:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564244:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564250:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564256:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564261:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564266:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564272:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564283:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564289:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564295:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564302:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564308:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564313:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564318:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564323:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564328:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564334:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564340:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564346:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564352:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564358:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564362:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564370:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564375:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564381:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564386:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599661.564392:0:20669:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1787599661.565383:0:20669:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b381bbd060 - data ffff96b3660435e8/ffff96b244328400 00000020:01000000:1.0:1787599661.565516:0:20669:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b243084540 - data ffff96b35267d510/ffff96b37bf7e400 00000020:00000080:1.0:1787599661.566142:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d03ae 00000020:00000080:1.0:1787599661.566151:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b24411f000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787599661.566201:0:20669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b377a86000 from MGS, refs=2 00000020:01000004:1.0:1787599661.566205:0:20669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b377a86000 2 00000020:01000004:1.0:1787599661.566208:0:20669:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b377a86000 from MGS 00000020:00000080:1.0:1787599661.566228:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599661.566233:0:20669:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787599661.566236:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b24411d800/MGS 00000020:00000080:1.0:1787599661.566239:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24411d800/MGS for MGS 00000020:01000000:1.0:1787599661.566244:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787599661.566302:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787599661.566306:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599661.566320:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599661.566328:0:20669:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96b381128000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599661.566334:0:20669:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff96b37f89cd28) has exports, disconnecting them 00000020:00080000:1.0:1787599661.566340:0:20669:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96b381128000), last request at 1787599561 00000020:00000080:1.0:1787599661.566344:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d04b1 00000020:00080000:1.0:1787599661.566354:0:20669:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b381128000): rc 0 00000020:00000080:1.0:1787599661.566358:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b381128000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787599661.566733:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24411f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787599661.566850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381128000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787599661.568984:0:20669:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787599661.568992:0:20669:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599661.568996:0:20669:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599661.569003:0:20669:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599661.569030:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3778e6000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787599661.569208:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599661.569216:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787599661.569220:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b381129800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787599661.569224:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b381129800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787599661.569229:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787599661.569299:0:20669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b377a86000 1 00000020:00000080:2.0:1787599661.569304:0:20669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d03a0 00000020:00000080:2.0:1787599661.569310:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b244119800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787599661.569318:0:20669:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787599661.569325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244119800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787599661.569333:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599661.569338:0:20669:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599661.569342:0:20669:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff96b3706f3370) has no exports 00000020:00000080:2.0:1787599661.650399:0:20669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599661.650416:0:20669:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787599661.650432:0:20669:0:(genops.c:885:class_export_put()) final put ffff96b377a86800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787599661.650438:0:20669:0:(genops.c:844:class_export_destroy()) destroying export ffff96b377a86800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787599661.650447:0:20669:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787599661.654508:0:20669:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b377a87000 00000020:02000400:2.0:1787599661.654609:0:20669:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787599662.143697:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599663.144521:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599664.165034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599664.165042:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787599664.165046:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599664.165055:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787599664.165062:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599664.165069:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b2437f2000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599664.165094:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433af800 x1874433578069888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599664.165154:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599664.165158:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787599664.165160:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599664.165164:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787599664.165166:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599664.165169:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b3434d7000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599664.165181:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433afb80 x1874433578070272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599664.165190:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599664.165192:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787599664.165194:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599664.165197:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787599664.165200:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599664.165203:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b3434d6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599664.165215:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ae680 x1874433578070400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599664.165230:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599664.165249:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787599664.165251:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599664.165265:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787599664.165268:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599664.165273:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b347dc9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599664.165286:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ac380 x1874433578070656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599664.165324:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578070144:0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.165421:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599664.165494:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599664.165500:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578070528:0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.165530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599664.165574:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070144 00000100:00100000:2.0:1787599664.165582:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070144 00000100:00100000:2.0:1787599664.165644:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599664.165655:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578070144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.165708:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578070144:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599664.165716:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599664.165740:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070528 00000100:00100000:2.0:1787599664.165744:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070528 00000100:00100000:2.0:1787599664.165775:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787599664.165782:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.165840:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578070528:12345-0@lo:400:kworker.0 Request processed in 59us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599664.165846:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787599664.165874:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599664.165880:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787599664.165911:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff96b2433ad500 x1874433578070528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599664.165924:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578070528:0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.165937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578070144:0@lo:400:kworker.0 00000100:00100000:1.0:1787599664.166534:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578069888:0@lo:38:kworker.0 00000100:00100000:1.0:1787599664.166634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599664.166666:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578070272:0@lo:38:kworker.0 00000100:00100000:1.0:1787599664.166689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599664.166708:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578070400:0@lo:38:kworker.0 00000100:00100000:1.0:1787599664.166728:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599664.166741:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578070656:0@lo:38:kworker.0 00000100:00100000:1.0:1787599664.166758:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599664.166814:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070272 00000100:00100000:1.0:1787599664.166819:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070272 00000100:00100000:1.0:1787599664.166840:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070400 00000100:00100000:1.0:1787599664.166842:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070400 00000100:00100000:1.0:1787599664.166849:0:18087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070656 00000100:00100000:1.0:1787599664.166851:0:18087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070656 00000100:00100000:1.0:1787599664.166859:0:18087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599664.166865:0:18087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874433578070272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787599664.166884:0:18087:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599664.167348:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578070016:0@lo:400:kworker.0 00000100:00100000:0.0:1787599664.167470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599664.167518:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787599664.167526:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578069760:0@lo:400:kworker.0 00000400:00000100:0.0:1787599664.167545:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578069760 offset 0 length 224: 4 00000100:00100000:0.0:1787599664.168244:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578070784:0@lo:400:kworker.0 00000100:00100000:0.0:1787599664.168769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599664.168821:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070784 00000100:00100000:0.0:1787599664.168828:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070784 00000100:00100000:0.0:1787599664.168887:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599664.168895:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578070784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787599664.169500:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599664.169665:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578069888 00000100:00100000:2.0:1787599664.169671:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578069888 00000100:00100000:2.0:1787599664.169700:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787599664.169708:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578069888:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787599664.169730:0:17103:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787599664.169787:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578069888:12345-0@lo:38:kworker.0 Request processed in 79us (3152us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599664.169816:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599664.170045:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578070784:12345-0@lo:400:kworker.0 Request processed in 1149us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599664.170052:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787599664.170073:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599664.170078:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578070400:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787599664.170089:0:17097:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599664.170131:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578070400:12345-0@lo:38:kworker.0 Request processed in 51us (3402us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599664.170137:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599664.170150:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599664.170155:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578070656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787599664.170164:0:17097:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599664.170201:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578070656:12345-0@lo:38:kworker.0 Request processed in 44us (3441us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599664.170206:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787599664.170384:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070016 00000100:00100000:0.0:1787599664.170389:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070016 00000100:00100000:2.0:1787599664.170459:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578070912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599664.170493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787599664.170536:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff96b2433adf80 x1874433578070784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599664.170551:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578070784:0@lo:400:kworker.0 00000100:00100000:2.0:1787599664.170628:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578070912 00000100:00100000:2.0:1787599664.170633:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578070912 00000100:00100000:2.0:1787599664.170670:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599664.170678:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578070912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599664.170703:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599664.170741:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578070912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599664.170755:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599664.170810:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578070912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787599664.185444:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599664.185681:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599664.185700:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578070016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599664.185826:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578070016:12345-0@lo:400:kworker.0 Request processed in 135us (18355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599664.185834:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599664.186103:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578070016:0@lo:400:kworker.0 00010000:00010000:0.0:1787599664.190761:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599664.191076:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599664.191086:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599664.191091:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578069888:0@lo:38:kworker.0 00000100:00080000:2.0:1787599664.193526:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599664.193541:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599664.194010:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578070400:0@lo:38:kworker.0 00000100:00080000:2.0:1787599664.194052:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599664.194057:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599664.194060:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578070656:0@lo:38:kworker.0 00000100:00100000:3.0:1787599664.214200:0:18087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1874433578070272:12345-0@lo:38:kworker.0 Request processed in 47325us (47500us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599664.214215:0:18087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1787599664.214277:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599664.214282:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599664.214286:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578070272:0@lo:38:kworker.0 00000100:00100000:1.0:1787599664.678503:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599664.678530:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578071040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599664.678630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599664.679088:0:18609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071040 00000100:00100000:2.0:1787599664.679099:0:18609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071040 00000100:00100000:2.0:1787599664.679160:0:18609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599664.679171:0:18609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578071040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787599664.679217:0:18609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787599664.679276:0:18609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578071040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599664.679283:0:18609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599664.679338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578071040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787599665.193702:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599666.216402:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599667.238005:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599667.350893:0:20870:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787599667.387010:0:20870:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787599667.387092:0:20870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.387111:0:20870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.387133:0:20870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.387141:0:20870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.387174:0:20870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787599667.387181:0:20870:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787599667.387214:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599667.387220:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787599667.387229:0:20870:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599667.387237:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787599667.387243:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599667.387245:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787599667.387249:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787599667.387469:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599667.387482:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.387492:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599667.387497:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.387510:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599667.387519:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599667.387526:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599667.387529:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787599667.387532:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787599667.387606:0:17087:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.387612:0:17087:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599667.387671:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.387680:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d059f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d05a6 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.387695:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599667.387697:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599667.387723:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599667.388282:0:20870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388295:0:20870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388302:0:20870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388323:0:20870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388342:0:20870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599667.388349:0:20870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388357:0:20870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388363:0:20870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388382:0:20870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388394:0:20870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787599667.388401:0:20870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388408:0:20870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388415:0:20870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388422:0:20870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388443:0:20870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787599667.388449:0:20870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388455:0:20870:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388461:0:20870:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388467:0:20870:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599667.388474:0:20870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787599667.388477:0:20870:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1787599667.388481:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787599667.388487:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388494:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e5000 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599667.388497:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388504:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787599667.388510:0:20870:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 10000000:00010000:1.0:1787599667.388511:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1787599667.388516:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 10000000:01000000:1.0:1787599667.388516:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599667.388519:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000020:00000080:2.0:1787599667.388521:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1787599667.388521:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00000080:2.0:1787599667.388527:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787599667.388537:0:20870:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff96b241a5d800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787599667.388543:0:20870:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff96b244112000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1787599667.388546:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787599667.388548:0:20870:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff96b37b5db370) has exports, disconnecting them 00000020:00080000:2.0:1787599667.388553:0:20870:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96b241a5d800), last request at 1787599664 00010000:00010000:1.0:1787599667.388553:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1787599667.388561:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d07dd 00010000:00010000:1.0:1787599667.388578:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787599667.388583:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b241a5e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787599667.388585:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e5000/0x5d2988b0929d04fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d0505 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388598:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787599667.388602:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388618:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599667.388621:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388627:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599667.388633:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787599667.388636:0:20870:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b241a5d800): rc 0 00000020:00000080:2.0:1787599667.388639:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b241a5d800/lustre-MDT0001-lwp-OST0001_UUID 10000000:01000000:1.0:1787599667.388639:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599667.388641:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787599667.388643:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1787599667.388649:0:20870:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96b244112000), last request at 1787599664 00010000:00010000:1.0:1787599667.388658:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787599667.388659:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d067f 00010000:00010000:1.0:1787599667.388663:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1787599667.388664:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b244115000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787599667.388669:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787599667.388672:0:20870:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b244112000): rc 0 00000020:00000080:2.0:1787599667.388674:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b244112000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:1.0:1787599667.388677:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b37b54b600/0x5d2988b0929d07eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d07f2 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1787599667.388683:0:20870:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb1441657ae0 00010000:00010000:1.0:1787599667.388694:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599667.388697:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388703:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599667.388705:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787599667.388710:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1787599667.388717:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599667.388719:0:20870:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff96b377b0ed80 x1874433578068224/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787599675 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1787599667.388724:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599667.388730:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787599667.388731:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 10000000:01000000:1.0:1787599667.388732:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787599667.388734:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787599667.388748:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388753:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599667.388760:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388767:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e4e00/0x5d2988b0929d0988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d098f expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388775:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599667.388778:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388783:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599667.388786:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388814:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599667.388830:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599667.388836:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599667.388838:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787599667.388840:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787599667.388854:0:17086:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388860:0:17086:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599667.388864:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388871:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e4200/0x5d2988b0929d04f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d2988b0929d04f7 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599667.388883:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599667.388885:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599667.388887:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599667.388911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578071296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599667.389014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599667.389091:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578068224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599667.389122:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599667.389127:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578071424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599667.389149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599667.389194:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071296 00000100:00100000:1.0:1787599667.389205:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071296 00000100:00100000:1.0:1787599667.389247:0:17853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071424 00000100:00100000:1.0:1787599667.389257:0:17853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071424 00000100:00100000:1.0:1787599667.389296:0:17853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599667.389305:0:17853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1874433578071296:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787599667.389313:0:17853:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599667 with bad export cookie 6713047011527820234 00000100:00080000:2.0:1787599667.389624:0:20870:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599667.389630:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b2437f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787599667.389893:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787599667.389897:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787599667.389914:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787599667.389973:0:20870:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787599667.389993:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787599667.390007:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787599667.390010:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787599667.390018:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787599667.390079:0:20870:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787599667.390087:0:20870:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787599667.390136:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff96b37b5db370) has no exports 00000100:00100000:0.0:1787599667.390443:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599667.390501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599667.390552:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787599667.390559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599667.390583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599667.390595:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599667.390618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787599667.390643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b241a5d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:3.0:1787599667.390690:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578071808:0@lo:9:umount.0 00000020:00000080:0.0:1787599667.390700:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244112000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787599667.390725:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b241a5e800 for lustre-MDT0001 00000100:00100000:3.0:1787599667.390729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787599667.390731:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244115000 for lustre-MDT0001 00000100:00100000:3.0:1787599667.390754:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578071936:0@lo:9:umount.0 00000100:00100000:3.0:1787599667.390774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599667.390893:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071808 00000100:00100000:3.0:1787599667.390901:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071808 00000100:00100000:3.0:1787599667.390955:0:18992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071936 00000100:00100000:3.0:1787599667.390958:0:18992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071936 00000100:00100000:3.0:1787599667.390981:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599667.390990:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874433578071808:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787599667.391024:0:18992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d06a9 00000100:00080000:3.0:1787599667.391034:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b36571e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599667.391094:0:18992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1787599667.391269:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599667.393808:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1874433578071808:12345-0@lo:9:umount.0 Request processed in 2792us (3050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599667.393827:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599667.393885:0:18992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599667.393914:0:18992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1874433578071936:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787599667.393955:0:18992:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d080e 00000100:00080000:3.0:1787599667.393986:0:18992:0:(import.c:65:import_set_state_nolock()) ffff96b34de1b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787599667.394054:0:18992:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787599667.394280:0:18992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1874433578071936:12345-0@lo:9:umount.0 Request processed in 384us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599667.394287:0:18992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787599667.394877:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599667.398921:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071552 00000100:00100000:2.0:1787599667.398942:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071552 00000100:00100000:2.0:1787599667.398994:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071168 00000100:00100000:2.0:1787599667.398997:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071168 00000100:00100000:2.0:1787599667.399004:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578071680 00000100:00100000:2.0:1787599667.399007:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578071680 00000100:00100000:2.0:1787599667.399024:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599667.399054:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874433578071424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599667.399063:0:17084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599667 with bad export cookie 6713047011527820234 00000100:00100000:2.0:1787599667.399557:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874433578071424:12345-0@lo:103:ldlm_bl.0 Request processed in 502us (10404us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599667.399567:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599667.399593:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599667.399598:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599667.399604:0:17084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599667 with bad export cookie 6713047011527820234 00000100:00080000:0.0:1787599667.399757:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787599667.399765:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787599667.399781:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.101@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1787599667.399872:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071552:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (9141us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599667.399880:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599667.399897:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599667.399902:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599667.399907:0:17084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599667 with bad export cookie 6713047011527820234 00000100:00100000:2.0:1787599667.399941:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071168:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (9357us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599667.399948:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599667.399962:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787599667.399967:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379eee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787599667.399972:0:17084:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787599667 with bad export cookie 6713047011527820234 00000100:00100000:2.0:1787599667.400000:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379eee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3645:x1874433578071680:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (9381us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787599667.400006:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787599667.402501:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787599667.402524:0:17093:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787599667.402639:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599667.402651:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599667.402654:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599667.402663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578071808:0@lo:9:umount.0 00000100:00080000:3.0:1787599667.402683:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b242df9000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787599667.402712:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787599667.402714:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787599667.402718:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578071936:0@lo:9:umount.0 00010000:00010000:3.0:1787599667.402851:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599667.403011:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.101@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787599667.425541:0:17853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1874433578071296:12345-0@lo:103:ldlm_bl.0 Request processed in 36226us (36518us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787599667.425561:0:17853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787599667.453433:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.101@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787599667.453440:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787599667.453450:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2433af100 x1874433578069760/t0(0) o400->MGC192.168.202.101@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787599680 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599667.453481:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2440ece00 x1874433578071296/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599683 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599667.453491:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b243479880 x1874433578071424/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599683 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599667.453501:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b243479f80 x1874433578071552/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599683 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599667.453512:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b34e5c2300 x1874433578071168/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599683 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599667.453521:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b351768700 x1874433578071680/t0(0) o103->MGC192.168.202.101@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787599683 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599667.453566:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3648:1874433578069760:0@lo:400:kworker.0 00000100:00080000:3.0:1787599667.455402:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96b244429800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1787599667.455428:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787599667.455438:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787599667.455439:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787599667.455445:0:3645:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787599667.455454:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578071296:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787599667.455455:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1787599667.455473:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b244429800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599667.455523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3647:1874433578071424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599667.455639:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b35176b800 x1874433578072064/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599667.455689:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599667.455698:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599667.455703:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3645:1874433578071552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599667.455874:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578072064:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1787599667.455942:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578072064 offset 0 length 520: 4 00000020:00080000:0.0:1787599667.462485:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff96b37b5db370) has no exports 00000020:01000000:2.0:1787599667.570961:0:20870:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242114e40 - data ffff96b36620f5e8/ffff96b34e5a1000 00000020:01000000:2.0:1787599667.571239:0:20870:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b241a1e240 - data ffff96b3526d5438/ffff96b344b9dc00 00000001:00000004:2.0:1787599667.584879:0:20870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1787599667.665160:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599667.665169:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787599667.665177:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787599667.667941:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599667.667951:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787599667.668133:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599667.668156:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787599667.669283:0:17838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787599667.669291:0:17838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787599667.669302:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787599667.669906:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599667.669911:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787599667.669925:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599667.669927:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787599667.670312:0:17840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787599667.670317:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1787599667.670324:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787599667.671240:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0513 00000020:00000080:0.0:1787599667.671249:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3534a7800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787599667.671990:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0528 00000020:00000080:0.0:1787599667.671999:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3819f6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787599667.672004:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787599667.672009:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599667.672019:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787599667.672023:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff96b37b5d8000) has no exports 00000004:01000000:0.0:1787599667.672340:0:20870:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787599667.672349:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d057c 00000020:00000080:0.0:1787599667.672353:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3534a6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787599667.672357:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787599667.672361:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599667.672377:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599667.672380:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96b3707bcd28) has no exports 00000020:00000080:0.0:1787599667.672386:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0575 00000020:00000080:0.0:1787599667.672390:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b242df8000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787599667.672634:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787599667.672644:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3819f6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787599667.672648:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787599667.672653:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b242df8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787599667.673019:0:20870:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787599667.673024:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787599667.673028:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787599667.673034:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599667.673037:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599667.673172:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599667.673179:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787599667.673185:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0567 00000020:00000080:0.0:1787599667.673190:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b34dd67000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599667.675179:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b242df9000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787599667.675196:0:38:0:(genops.c:885:class_export_put()) final put ffff96b34dd62800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599667.675199:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34dd62800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787599667.675206:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787599667.675597:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787599667.675605:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599667.675629:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599667.675634:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96b3707b99b8) has no exports 00000020:00000080:0.0:1787599667.675642:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0559 00000020:00000080:0.0:1787599667.675649:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b346318000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787599667.675975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34dd67000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787599667.678769:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b346318000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787599667.681029:0:20870:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787599667.681106:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787599667.681111:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787599667.681121:0:20870:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787599667.681124:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599667.681181:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599667.681191:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787599667.681208:0:20870:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787599667.681217:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d054b 00000020:00000080:0.0:1787599667.681227:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3534a4800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787599667.681235:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787599667.681243:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599667.681248:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787599667.681252:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff96b37b5d99b8) has no exports 00000020:00000080:0.0:1787599667.681259:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0544 00000020:00000080:0.0:1787599667.681262:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b2437f3000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787599667.681644:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34631c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787599667.681653:0:38:0:(genops.c:885:class_export_put()) final put ffff96b34dd64800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599667.681656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34dd64800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787599667.681663:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599667.681752:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787599667.681769:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2437f3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787599667.683968:0:20870:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787599667.683975:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599667.683979:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787599667.683988:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599667.684048:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599667.684059:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599667.684089:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599667.684093:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599667.684098:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b354b72000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599667.684103:0:20870:0:(genops.c:844:class_export_destroy()) destroying export ffff96b354b72000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787599667.684110:0:20870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787599667.684268:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d052f 00000020:00000080:1.0:1787599667.684275:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3819f2000/lustre-MDD0001_UUID 00000020:01000000:1.0:1787599667.684280:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787599667.684283:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599667.684287:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787599667.684291:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff96b37b5dcd28) has no exports 00000020:00000080:1.0:1787599667.684307:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599667.684310:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787599667.684313:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0536 00000020:00000080:1.0:1787599667.684316:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3819f1800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787599667.684323:0:20870:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f890800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787599667.684338:0:20870:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f890800 2 00000020:01000004:1.0:1787599667.684342:0:20870:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b37f890800 from lustre-MDT0001 00000020:00000080:1.0:1787599667.684381:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599667.684386:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787599667.684389:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3534a4000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787599667.684391:0:20870:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a4000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787599667.684400:0:20870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787599667.684428:0:20870:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787599667.684432:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787599667.684435:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599667.684438:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599667.684446:0:20870:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff96b3434d4800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599667.684451:0:20870:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff96b344af8000) has exports, disconnecting them 00000020:00080000:1.0:1787599667.684455:0:20870:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff96b3434d4800), last request at 1787599577 00000020:00000080:1.0:1787599667.684459:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d05b4 00000020:00080000:1.0:1787599667.684471:0:20870:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b3434d4800): rc 0 00000020:00000080:1.0:1787599667.684475:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3434d4800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787599667.685318:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b2437f2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787599667.685330:0:38:0:(genops.c:885:class_export_put()) final put ffff96b3534a2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787599667.685333:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787599667.685344:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599667.685459:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3819f2000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787599667.685464:0:38:0:(genops.c:885:class_export_put()) final put ffff96b3534a1800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787599667.685466:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3534a1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787599667.685469:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787599667.685608:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3819f1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787599667.685613:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d4800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787599667.715015:0:20870:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787599667.715028:0:20870:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599667.715033:0:20870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599667.715042:0:20870:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787599667.715079:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d7000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787599667.715287:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599667.715296:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787599667.715302:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b3434d1000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787599667.715306:0:20870:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3434d1000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787599667.715316:0:20870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787599667.715426:0:20870:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f890800 1 00000020:00000080:2.0:1787599667.715433:0:20870:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d04db 00000020:00000080:2.0:1787599667.715440:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b37f896000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787599667.715449:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787599667.715458:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f896000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787599667.715466:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599667.715482:0:20870:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599667.715487:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff96b242c3b370) has no exports 00000020:00000080:2.0:1787599667.930911:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599667.930928:0:20870:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787599667.930935:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b37f892800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787599667.930940:0:20870:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37f892800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787599667.930954:0:20870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787599667.931075:0:20870:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b37f893800 00000020:01000000:2.0:1787599667.931094:0:20870:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787599667.931099:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599667.931104:0:20870:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599667.931108:0:20870:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff96b3707799b8) has no exports 00000100:00100000:0.0:1787599667.931350:0:17097:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff96b381268200:17097] 0 exiting: rc = 1 00000100:00100000:0.0:1787599667.931500:0:17099:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96b2435ff200:17099] 2 exiting: rc = 0 00000100:00100000:3.0:1787599667.931839:0:17098:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96b349a7a800:17098] 1 exiting: rc = 0 00000100:00100000:3.0:1787599667.931909:0:18087:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96b344b70a00:18087] 3 exiting: rc = 0 00000100:00100000:2.0:1787599667.932066:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932074:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932079:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932084:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932089:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932094:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932099:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932106:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932111:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932117:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932122:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932127:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932132:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932137:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932143:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932148:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932153:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932158:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932163:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932168:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932173:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932179:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932200:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932206:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932211:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932216:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932221:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932227:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932232:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932238:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932244:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932249:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932255:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932261:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932265:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932270:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932275:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932279:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932284:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932290:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932295:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932300:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932306:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932312:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932318:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932323:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932329:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932335:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932341:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932346:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932352:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932359:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932379:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932387:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932392:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932397:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932402:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932413:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932418:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.932424:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.933232:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.933250:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.933257:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.933263:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.947159:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96b379d6e600:17100] 0 exiting: rc = 1 00000100:00100000:0.0:1787599667.947258:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96b379d6ea00:17101] 1 exiting: rc = 0 00000100:00100000:2.0:1787599667.949034:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949049:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949055:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949060:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949066:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949071:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949075:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949081:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949086:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949091:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949096:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949101:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949106:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949110:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949115:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949120:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949125:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949130:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949135:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949140:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949146:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949152:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949156:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949161:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949165:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949170:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949175:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949180:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949205:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949211:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949216:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949222:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949227:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949232:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949237:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949243:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949248:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949255:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949260:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949266:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949271:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949291:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949297:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949303:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949308:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949314:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949320:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949325:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949343:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949350:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949355:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949361:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949377:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949382:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949388:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949394:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949400:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949405:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949410:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949415:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949421:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949425:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949441:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.949454:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950116:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96b370670800:17103] 1 exiting: rc = 0 00000100:00100000:0.0:1787599667.950297:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96b342a6a000:17102] 0 exiting: rc = 1 00000100:00100000:2.0:1787599667.950528:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950535:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950541:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950546:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950553:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950558:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950647:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950657:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950662:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950669:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950676:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950682:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950688:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950694:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950702:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950710:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950715:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950722:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950745:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950754:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950761:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950771:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950778:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950784:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950826:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950835:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950841:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950848:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950853:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950859:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950883:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950891:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950897:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950915:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950920:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950926:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950932:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950938:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950944:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950950:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950956:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950962:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950982:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950990:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.950996:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951002:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951009:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951014:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951021:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951027:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951032:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951038:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951043:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951049:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951069:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951077:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951082:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951088:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951093:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951100:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951106:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951112:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951117:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.951123:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.970922:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96b370671600:17104] 0 exiting: rc = 1 00000100:00100000:2.0:1787599667.973052:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96b370671400:17105] 1 exiting: rc = 0 00000100:00100000:0.0:1787599667.975534:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975546:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975552:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975558:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975564:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975569:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975574:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975886:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975892:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975898:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975903:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975909:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975914:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975920:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975925:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975930:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975935:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975941:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975946:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975951:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975956:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975961:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975966:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975971:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975976:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975981:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975986:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975991:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.975996:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976001:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976005:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976010:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976014:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976019:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976025:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976030:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976035:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976040:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976045:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976050:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976056:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976062:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976075:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976080:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976086:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976091:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976097:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976102:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976107:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976112:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976118:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976124:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976129:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976134:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976140:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976145:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976150:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976156:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976161:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976166:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976170:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976176:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976181:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.976185:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.976877:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff96b370670e00:17107] 1 exiting: rc = 0 00000100:00100000:2.0:1787599667.976915:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff96b370671000:17106] 0 exiting: rc = 1 00000100:00100000:1.0:1787599667.981607:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981617:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981622:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981627:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981633:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981638:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981643:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981649:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981655:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981660:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981665:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981669:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981689:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981694:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981698:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981703:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981708:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981713:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981718:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981723:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981728:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981733:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981738:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981743:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981747:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981752:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981756:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981761:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981771:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981776:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981782:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981786:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981807:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981813:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981818:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981823:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981828:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981833:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981839:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981844:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981849:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981854:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981859:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981863:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981868:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981873:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981889:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981901:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981906:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981911:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981916:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981921:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981925:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981930:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981935:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981940:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981945:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981950:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981955:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981960:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981965:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981970:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981975:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.981980:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787599667.982349:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff96b370671800:17109] 1 exiting: rc = 0 00000100:00100000:3.0:1787599667.982543:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff96b370670a00:17108] 0 exiting: rc = 1 00000100:00100000:1.0:1787599667.982675:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982681:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982687:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982692:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982697:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982703:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982709:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982714:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982719:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982724:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982729:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982734:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982739:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982744:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982749:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982754:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982759:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982763:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982777:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982783:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982789:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982849:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982855:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982861:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982866:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982871:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982876:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982881:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982886:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982891:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982896:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982901:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982905:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982911:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982917:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982922:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982927:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982933:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982939:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982944:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982950:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982954:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982960:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982964:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982969:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982974:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982979:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982984:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982989:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.982994:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983000:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983005:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983009:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983022:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983026:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983031:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983037:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983042:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983047:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983052:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983057:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983062:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983067:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599667.983072:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599667.983957:0:17111:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff96b34dd6ac00:17111] 1 exiting: rc = 0 00000100:00100000:2.0:1787599667.984131:0:17112:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff96b34dd6a600:17112] 2 exiting: rc = 0 00000100:00100000:0.0:1787599667.984411:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff96b370671200:17110] 0 exiting: rc = 1 00000100:00100000:3.0:1787599667.984572:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984652:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984666:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984672:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984678:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984685:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984690:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984697:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984705:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984711:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984719:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984726:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984732:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984739:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984745:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984752:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984758:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984764:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984770:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984777:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984783:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984820:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984841:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984847:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984854:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984860:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984867:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984873:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984880:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984887:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984893:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984899:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984904:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984909:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984914:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984919:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984925:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984939:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984945:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984950:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984956:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984961:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984967:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984971:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984977:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.984982:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985002:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985009:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985016:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985023:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985031:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985036:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985042:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985048:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985054:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985059:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985066:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985072:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985077:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985082:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985087:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985093:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985099:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599667.985105:0:20870:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787599667.991965:0:20870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599667.991984:0:20870:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787599667.991991:0:20870:0:(genops.c:885:class_export_put()) final put ffff96b24442a800/MDS_uuid 00000020:00000080:3.0:1787599667.991997:0:20870:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24442a800/MDS_uuid for MDS 00000020:01000000:3.0:1787599667.992004:0:20870:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787599667.992189:0:20870:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787599668.261540:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599669.284952:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787599669.287104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599669.287139:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599669.287143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599669.287148:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599669.287152:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599669.287164:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 610 00000100:00080000:3.0:1787599669.287172:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599669.287183:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b3434d6000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599669.287239:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0c380 x1874433578072192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599669.287307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599669.287311:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787599669.287312:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599669.287326:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 610 00000100:00080000:3.0:1787599669.287329:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599669.287338:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b347dc9800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599669.287350:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0ce00 x1874433578072448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599669.287398:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578072320:0@lo:400:kworker.0 00000100:00100000:0.0:1787599669.287555:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578072192:0@lo:38:kworker.0 00000400:00000100:0.0:1787599669.287610:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072192 offset 0 length 520: 4 00000100:00100000:0.0:1787599669.287641:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578072448:0@lo:38:kworker.0 00000400:00000100:0.0:1787599669.287657:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072448 offset 0 length 520: 4 00000400:00000100:3.0:1787599669.287721:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072320 offset 0 length 224: 4 00000100:00100000:3.0:1787599669.287736:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599669.287741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578072576:0@lo:400:kworker.0 00000400:00000100:3.0:1787599669.287756:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072576 offset 0 length 224: 4 00010000:00010000:1.0:1787599670.309202:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599671.335531:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787599672.183285:0:21071:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787599672.204010:0:21071:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787599672.204065:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599672.204079:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599672.204086:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599672.204093:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599672.204115:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787599672.204120:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787599672.204144:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599672.204154:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0c380 x1874433578072192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599672.204386:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787599672.204393:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599672.204399:0:21071:0:(import.c:65:import_set_state_nolock()) ffff96b3434d6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787599672.204404:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787599672.204408:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0c380 x1874433578072192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599672.204415:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787599672.204419:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1787599672.204854:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578072192:0@lo:38:kworker.0 00010000:00010000:1.0:1787599672.205000:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599672.205009:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599672.205018:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ae00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599672.205022:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599672.205034:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599672.205042:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599672.205047:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787599672.205050:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787599672.205052:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787599672.205067:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:1.0:1787599672.205071:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599672.205097:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b37b54ae00/0x5d2988b0929d064e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0655 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599672.205108:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599672.205110:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599672.205112:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599672.206279:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787599672.206293:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0f100 x1874433578072320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599672.206340:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787599672.206347:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787599672.206370:0:21071:0:(import.c:65:import_set_state_nolock()) ffff96b365719800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787599672.207213:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578072704:0@lo:39:umount.0 00000400:00000100:1.0:1787599672.207264:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072704 offset 0 length 224: 4 00000100:00100000:3.0:1787599672.207414:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578072320:0@lo:400:kworker.0 00010000:00010000:3.0:1787599672.358178:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787599673.317083:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599673.317093:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599673.317096:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599673.317099:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599673.317255:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599673.317277:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578072832:0@lo:400:kworker.0 00000400:00000100:3.0:1787599673.317362:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072832 offset 0 length 224: 4 00010000:00010000:0.0:1787599673.381139:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599673.383150:0:18601:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787599673.383279:0:18601:0:(genops.c:885:class_export_put()) final put ffff96b36571f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787599673.383301:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff96b36571f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787599673.383365:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b36571e000 for lustre-OST0000 00000001:00100000:2.0:1787599673.383831:0:19420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787599673.383835:0:19420:0:(genops.c:885:class_export_put()) final put ffff96b34de1d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787599673.383893:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34de1d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787599673.383929:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b34de1b000 for lustre-OST0001 00000100:00080000:2.0:1787599674.340937:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599674.340949:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599674.340952:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787599674.340955:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599674.341066:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599674.344914:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578072960:0@lo:400:kworker.0 00000400:00000100:1.0:1787599674.344996:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578072960 offset 0 length 224: 4 00010000:00010000:3.0:1787599674.405338:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599675.430562:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599676.453044:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599677.350049:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599667/real 1787599667] req@ffff96b35176b800 x1874433578072064/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599677 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599677.350094:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b35176b800 x1874433578072064/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787599677 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599677.350115:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599677.350144:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787599677.350148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578072064:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787599677.350244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599677.350249:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787599677.350252:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599677.350267:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 614 00000100:00080000:3.0:1787599677.350272:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.101@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599677.350279:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b244429800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599677.350324:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0f100 x1874433578073088/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599677.350348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599677.350353:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599677.350492:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578073216:0@lo:400:kworker.0 00000400:00000100:0.0:1787599677.350547:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578073216 offset 0 length 224: 4 00000100:00100000:1.0:1787599677.350553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578073088:0@lo:250:kworker.0 00000400:00000100:1.0:1787599677.350574:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874433578073088 offset 0 length 520: 4 00010000:00010000:0.0:1787599677.478230:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599678.501407:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599679.525473:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599680.550415:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599681.573149:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599682.472000:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599672/real 1787599672] req@ffff96b2433af480 x1874433578072704/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599682.472035:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433af480 x1874433578072704/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599682.472055:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b365719800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787599682.472073:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578072704:0@lo:39:umount.0 00000100:00080000:2.0:1787599682.472181:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787599682.472186:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787599682.472191:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787599682.473385:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473401:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473426:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473433:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473459:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599682.473467:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473473:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473478:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473485:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599682.473504:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787599682.473509:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787599682.473534:0:21071:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787599682.473537:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787599682.473541:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787599682.473695:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599682.473702:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473710:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599682.473713:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473722:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599682.473728:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599682.473734:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599682.473736:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787599682.473739:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787599682.473761:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599682.473764:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473769:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e4600/0x5d2988b0929d0624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d062b expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473780:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599682.473787:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473830:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b2440e4800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599682.473832:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473836:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599682.473841:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599682.473844:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787599682.473845:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787599682.473846:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787599682.473851:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599682.473856:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473860:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b2440e4800/0x5d2988b0929d097a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0981 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599682.473866:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599682.473867:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599682.473869:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599682.474115:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787599682.479076:0:21071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599682.479099:0:21071:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff96b344afb370) has no exports 00000020:00080000:2.0:1787599682.479144:0:21071:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff96b344afb370) has no exports 00000020:01000000:2.0:1787599682.483291:0:21071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b381bbd480 - data ffff96b3527e2288/ffff96b24432b400 00000020:01000000:2.0:1787599682.483412:0:21071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b3534b4240 - data ffff96b241c041b0/ffff96b37b55dc00 00100000:10000000:2.0:1787599682.493657:0:21071:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787599682.508360:0:21071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0639 00000020:00000080:3.0:1787599682.508374:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b37b7a6000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787599682.508398:0:21071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b3440db800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787599682.508409:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3440db800 2 00000020:01000004:3.0:1787599682.508412:0:21071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b3440db800 from lustre-OST0000 00000020:00000080:3.0:1787599682.508436:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599682.508447:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787599682.508449:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b37b7a5800/lustre-OST0000_UUID 00000020:00000080:3.0:1787599682.508452:0:21071:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37b7a5800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787599682.508472:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787599682.508531:0:21071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787599682.508535:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787599682.508539:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599682.508543:0:21071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787599682.508562:0:21071:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96b36571c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787599682.508568:0:21071:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff96b344afcd28) has exports, disconnecting them 00000020:00080000:3.0:1787599682.508574:0:21071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96b36571c800), last request at 1787599595 00000020:00000080:3.0:1787599682.508579:0:21071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0663 00000020:00080000:3.0:1787599682.508589:0:21071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b36571c800): rc 0 00000020:00000080:3.0:1787599682.508594:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b36571c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787599682.508947:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37b7a6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787599682.508961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b36571c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787599682.540874:0:21071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787599682.540885:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787599682.540891:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787599682.540899:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787599682.541085:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599682.541108:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787599682.541115:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787599682.541119:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787599682.541123:0:21071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787599682.541130:0:21071:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff96b244114800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787599682.541138:0:21071:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff96b37f8999b8) has exports, disconnecting them 00000020:00080000:0.0:1787599682.541142:0:21071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff96b244114800), last request at 1787599595 00000020:00000080:0.0:1787599682.541147:0:21071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0678 00000020:00080000:0.0:1787599682.541176:0:21071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b244114800): rc 0 00000020:00000080:0.0:1787599682.541182:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b244114800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787599682.542117:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b3434d6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787599682.542129:0:36:0:(genops.c:885:class_export_put()) final put ffff96b37b7a1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787599682.542132:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b37b7a1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787599682.542144:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787599682.542217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244114800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787599682.542252:0:21071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787599682.542256:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599682.542260:0:21071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787599682.542265:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599682.542282:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b365719800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787599682.542425:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599682.542432:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787599682.542436:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b36571e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787599682.542439:0:21071:0:(genops.c:844:class_export_destroy()) destroying export ffff96b36571e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787599682.542442:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787599682.542467:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b3440db800 1 00000020:00000080:1.0:1787599682.542480:0:21071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0616 00000020:00000080:1.0:1787599682.542485:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b2434d1000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787599682.542493:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787599682.542500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787599682.542508:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599682.542512:0:21071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787599682.542515:0:21071:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff96b34dcf99b8) has no exports 00000100:00080000:3.0:1787599682.597861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599682.597871:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599682.597875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599682.597878:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787599682.597997:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599682.598068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599682.598098:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578073344:0@lo:400:kworker.0 00000400:00000100:0.0:1787599682.598155:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578073344 offset 0 length 224: 4 00000020:00000080:2.0:1787599682.603866:0:21071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787599682.603879:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787599682.603885:0:21071:0:(genops.c:885:class_export_put()) final put ffff96b3440de800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787599682.603889:0:21071:0:(genops.c:844:class_export_destroy()) destroying export ffff96b3440de800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787599682.603901:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787599682.604013:0:21071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b3440d9000 00000020:02000400:2.0:1787599682.604058:0:21071:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787599683.621716:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599684.644979:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1787599685.668925:0:3647:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599669/real 1787599669] req@ffff96b377b0df80 x1874433578072576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599685 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787599685.672834:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599685.699144:0:3647:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff96b377b0df80 x1874433578072576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787599685 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787599685.699160:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96b244111800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787599685.699164:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787599685.724246:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1787599685.727446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578072576:0@lo:400:kworker.0 00000100:00080000:3.0:1787599685.729607:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599685.729616:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599685.729619:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599685.729623:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599685.729626:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787599685.729629:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787599685.729633:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b244111800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599685.729641:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1787599685.729919:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96b244111800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599685.729952:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0ea00 x1874433578073472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599685.730026:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578073472:0@lo:38:kworker.0 00000400:00000100:0.0:1787599685.730081:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874433578073472 offset 0 length 520: 4 00000020:01000004:0.0:1787599686.623341:0:21274:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787599686.645891:0:21274:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787599686.645962:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599686.645973:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599686.645979:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599686.645983:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599686.645998:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787599686.646002:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787599686.646021:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599686.646030:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0ce00 x1874433578072448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.646044:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787599686.646048:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787599686.646054:0:21274:0:(import.c:65:import_set_state_nolock()) ffff96b347dc9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787599686.646057:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599686.646075:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0ce00 x1874433578072448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599689 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.646083:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787599686.646087:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1787599686.646171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578072448:0@lo:38:kworker.0 00000100:00080000:1.0:1787599686.647104:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599686.647117:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2433aea00 x1874433578072832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.647137:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b2433aca80 x1874433578072960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.647154:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0d880 x1874433578073216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599693 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.647175:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0e300 x1874433578073344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599698 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.647183:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0ea00 x1874433578073472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787599695 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.647193:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787599686.647536:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578072832:0@lo:400:kworker.0 00000100:00080000:2.0:1787599686.647571:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b244111800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599686.647576:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787599686.647579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578073472:0@lo:38:kworker.0 00000100:00100000:1.0:1787599686.648343:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578072960:0@lo:400:kworker.0 00000100:00080000:1.0:1787599686.648376:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787599686.648382:0:21274:0:(import.c:65:import_set_state_nolock()) ffff96b244111800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787599686.648388:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787599686.648394:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0d880 x1874433578073216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599693 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.648403:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0e300 x1874433578073344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599698 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599686.648410:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787599686.648413:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1787599686.648497:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599686.648522:0:17086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.648532:0:17086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599686.648536:0:17086:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.648546:0:17086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599686.648554:0:17086:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599686.648559:0:17086:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599686.648562:0:17086:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787599686.648565:0:17086:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787599686.648581:0:17086:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599686.648585:0:17086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.648592:0:17086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b243758c00/0x5d2988b0929d07ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d07b3 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.648605:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599686.648607:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599686.648609:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599686.648641:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578073344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599686.648660:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578073216:0@lo:400:kworker.0 00010000:00010000:2.0:1787599686.649545:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649558:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649565:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649571:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649587:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599686.649592:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649606:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649610:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649613:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599686.649619:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787599686.649621:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787599686.649644:0:21274:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787599686.649647:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787599686.649649:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787599686.649653:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787599686.649657:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff96b34dcfcd28) has no exports 00000020:00080000:2.0:1787599686.649675:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff96b34dcfcd28) has no exports 00000020:01000000:2.0:1787599686.651108:0:21274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b381bbd6c0 - data ffff96b241c38798/ffff96b344bd6000 00000020:01000000:2.0:1787599686.651278:0:21274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96b242114ea0 - data ffff96b3663c2af8/ffff96b244325800 00010000:00010000:0.0:1787599686.651620:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599686.651635:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651643:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599686.651646:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651653:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599686.651658:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599686.651661:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599686.651663:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787599686.651665:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787599686.651677:0:17087:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599686.651680:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651684:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0789 expref: -99 pid: 19419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651691:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599686.651693:0:17087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651696:0:17087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3cc00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599686.651698:0:17087:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651708:0:17087:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599686.651712:0:17087:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599686.651715:0:17087:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787599686.651716:0:17087:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787599686.651717:0:17087:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787599686.651720:0:17087:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599686.651721:0:17087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651725:0:17087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d096c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d0973 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.651732:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599686.651733:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599686.651734:0:17087:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599686.651739:0:17086:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787599686.660573:0:21274:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787599686.668414:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d0797 00000020:00000080:0.0:1787599686.668428:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b244232000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787599686.668450:0:21274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37b7a4000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787599686.668454:0:21274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37b7a4000 2 00000020:01000004:0.0:1787599686.668458:0:21274:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96b37b7a4000 from lustre-OST0001 00000020:00000080:0.0:1787599686.668489:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787599686.668498:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787599686.668502:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b244230800/lustre-OST0001_UUID 00000020:00000080:0.0:1787599686.668505:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244230800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787599686.668512:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787599686.668602:0:21274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0656b88f-dbfb-4f1b-a90c-8b5223ca997d->MGS 00010000:00010000:0.0:1787599686.668635:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599686.668647:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599686.668654:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787599686.668657:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787599686.668660:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787599686.668675:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599686.668680:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200ca00/0x5d2988b0929d04e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d04e9 expref: -99 pid: 17829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599686.668695:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599686.668701:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599686.668721:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787599686.668725:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787599686.668727:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787599686.668742:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96b244429800 00010000:00010000:0.0:1787599686.668746:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b34152be00/0x5d2988b0929d03d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d2988b0929d03d8 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787599686.668765:0:21274:0:(import.c:65:import_set_state_nolock()) ffff96b244429800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787599686.668769:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787599686.668771:0:21274:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787599686.668773:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787599686.668777:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787599686.668828:0:21274:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96b377b0f100 x1874433578073088/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787599692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787599686.668845:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787599686.668849:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1787599686.668931:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244232000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1787599686.669083:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0656b88f-dbfb-4f1b-a90c-8b5223ca997d:3644:1874433578073088:0@lo:250:kworker.0 10000000:01000000:1.0:1787599686.669153:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787599686.669160:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d03bc 00000020:00000080:1.0:1787599686.669164:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b24442c000/0656b88f-dbfb-4f1b-a90c-8b5223ca997d 00000020:01000000:1.0:1787599686.669178:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.101@tcp (flags='') 00000020:00000080:1.0:1787599686.669184:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599686.669190:0:21274:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.101@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787599686.669194:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff96b370778000) has no exports 00000020:00000080:3.0:1787599686.669250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b24442c000/0656b88f-dbfb-4f1b-a90c-8b5223ca997d for MGC192.168.202.101@tcp 10000000:01000000:3.0:1787599686.669854:0:17094:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787599686.670087:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.101@tcp: client import never connected 00000100:00080000:1.0:1787599686.670091:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787599686.670094:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787599686.670097:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787599686.670099:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787599686.670150:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599686.670157:0:21274:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.101@tcp (uuid 0656b88f-dbfb-4f1b-a90c-8b5223ca997d) 00000020:01000000:1.0:1787599686.670164:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787599686.670168:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599686.670173:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599686.670179:0:21274:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff96b354b72800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599686.670184:0:21274:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff96b242c3cd28) has exports, disconnecting them 00000020:00080000:1.0:1787599686.670189:0:21274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff96b354b72800), last request at 1787599612 00000020:00000080:1.0:1787599686.670194:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d07c1 00000020:00080000:1.0:1787599686.670216:0:21274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b354b72800): rc 0 00000020:00000080:1.0:1787599686.670221:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b354b72800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787599686.670941:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244429800 for MGC192.168.202.101@tcp 00000020:00000080:3.0:1787599686.670951:0:36:0:(genops.c:885:class_export_put()) final put ffff96b244428000/0656b88f-dbfb-4f1b-a90c-8b5223ca997d 00000020:00000080:3.0:1787599686.670954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244428000/0656b88f-dbfb-4f1b-a90c-8b5223ca997d for MGC192.168.202.101@tcp 00000020:01000000:3.0:1787599686.670960:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.101@tcp (0656b88f-dbfb-4f1b-a90c-8b5223ca997d) 00000020:00000080:3.0:1787599686.671195:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b354b72800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787599686.684263:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787599686.684272:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787599686.684277:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787599686.684284:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787599686.684507:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787599686.684515:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1787599686.684521:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787599686.684534:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787599686.684539:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787599686.684547:0:21274:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff96b34de19800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787599686.684553:0:21274:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff96b344af99b8) has exports, disconnecting them 00000020:00080000:1.0:1787599686.684558:0:21274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff96b34de19800), last request at 1787599612 00000020:00000080:1.0:1787599686.684562:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d07d6 00000020:00080000:1.0:1787599686.684576:0:21274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96b34de19800): rc 0 00000020:00000080:1.0:1787599686.684581:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b34de19800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787599686.684965:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b347dc9800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787599686.684975:0:36:0:(genops.c:885:class_export_put()) final put ffff96b244113000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787599686.684978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244113000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787599686.684984:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787599686.686417:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34de19800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787599686.693034:0:21274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787599686.693043:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787599686.693048:0:21274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787599686.693055:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787599686.693155:0:17087:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787599686.693308:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96b244111800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787599686.693393:0:17086:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1787599686.693586:0:17082:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff96b2440c4200:17082] 1 exiting: rc = 0 00000100:00100000:0.0:1787599686.693767:0:17081:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96b242db6600:17081] 0 exiting: rc = 1 00000100:00100000:2.0:1787599686.693959:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.694265:0:17084:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96b2440c5a00:17084] 1 exiting: rc = 0 00000100:00100000:3.0:1787599686.694379:0:20126:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff96b243190200:20126] 4 exiting: rc = 0 00000100:00100000:3.0:1787599686.694455:0:17085:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96b343c85e00:17085] 2 exiting: rc = 0 00000100:00100000:0.0:1787599686.694537:0:17083:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96b2440c5200:17083] 0 exiting: rc = 1 00000100:00100000:1.0:1787599686.695157:0:17853:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96b344b8de00:17853] 3 exiting: rc = 0 00000100:00100000:2.0:1787599686.695382:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695390:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695395:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695413:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695420:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695426:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695432:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695437:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695443:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695449:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695455:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695460:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695465:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695469:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695475:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695480:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695485:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695490:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695495:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695501:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695506:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695511:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695516:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695521:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695526:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695531:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695536:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695541:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695545:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695550:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695555:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695561:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695566:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695571:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695576:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695581:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695586:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695591:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695603:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695608:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695624:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695690:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695696:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695701:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695714:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695725:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695730:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695941:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695948:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695953:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695959:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695965:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695971:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695976:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695980:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695986:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695991:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.695995:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696000:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696005:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696011:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696017:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696021:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.696026:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787599686.697777:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599686.697819:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787599686.697826:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b34de18000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787599686.697831:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff96b34de18000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787599686.697837:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787599686.697898:0:21274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37b7a4000 1 00000020:00000080:3.0:1787599686.697913:0:21274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d2988b0929d077b 00000020:00000080:3.0:1787599686.697919:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b244110000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787599686.697933:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787599686.697937:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599686.697942:0:21274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787599686.697946:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff96b345e08000) has no exports 00000020:00000080:2.0:1787599686.700297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96b244110000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787599686.735594:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599686.735610:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787599686.735628:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b242cd2800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787599686.735633:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff96b242cd2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787599686.735645:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787599686.735978:0:21274:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96b3812ca800 00000020:01000000:3.0:1787599686.736006:0:21274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787599686.736010:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787599686.736015:0:21274:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787599686.736020:0:21274:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff96b37f898000) has no exports 00000020:00000080:3.0:1787599686.736038:0:21274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787599686.736043:0:21274:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787599686.736046:0:21274:0:(genops.c:885:class_export_put()) final put ffff96b2434d0800/OSS_uuid 00000020:00000080:3.0:1787599686.736048:0:21274:0:(genops.c:844:class_export_destroy()) destroying export ffff96b2434d0800/OSS_uuid for OSS 00000020:01000000:3.0:1787599686.736051:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787599686.736139:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96b344b6ec00:18605] 1 exiting: rc = 0 00000100:00080000:0.0:1787599686.736237:0:17093:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787599686.736370:0:18992:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96b344bccc00:18992] 3 exiting: rc = 0 00000100:00100000:1.0:1787599686.736488:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96b344a70400:18604] 0 exiting: rc = 1 00000100:00100000:2.0:1787599686.736688:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96b344b6f000:18606] 2 exiting: rc = 0 00000100:00100000:2.0:1787599686.736972:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.736980:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.736985:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.736991:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.736996:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737001:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737006:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737022:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737028:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737033:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737038:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737043:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737049:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737054:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737060:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737081:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737088:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737097:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737103:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737108:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737118:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737123:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737129:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737135:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737141:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737145:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737151:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737156:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737160:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737165:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737170:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737175:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737179:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737184:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737188:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737194:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737209:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737215:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737220:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737225:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737231:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737236:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737247:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737254:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737259:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737264:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737269:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737274:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737279:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737284:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737290:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737295:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737300:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737306:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737311:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737316:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737321:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737327:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737332:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737337:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737342:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737347:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737352:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.737357:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599686.738991:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff96b3779ce600:18608] 0 exiting: rc = 1 00000100:00100000:3.0:1787599686.739326:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96b24334e000:18609] 1 exiting: rc = 0 00000100:00100000:2.0:1787599686.739443:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739455:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739462:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739467:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739473:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739478:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739484:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739489:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739495:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739500:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739506:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739510:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739515:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739535:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739540:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739545:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739550:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739555:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739561:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739566:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739571:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739577:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739582:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739587:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739592:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739598:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739603:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739608:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739613:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739618:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739623:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739695:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739701:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739967:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739977:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739983:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739988:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739994:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.739999:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740005:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740011:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740018:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740025:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740030:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740036:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740041:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740046:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740052:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740118:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740124:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740129:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740135:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740140:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740145:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740151:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740157:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740162:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740168:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740173:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740179:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740183:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740188:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740194:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.740209:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.742136:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96b24334ea00:18612] 2 exiting: rc = 0 00000100:00100000:2.0:1787599686.742378:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96b3779ce400:18610] 0 exiting: rc = 1 00000100:00100000:1.0:1787599686.742566:0:18611:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96b344b01600:18611] 1 exiting: rc = 0 00000100:00100000:2.0:1787599686.743041:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743049:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743055:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743060:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743122:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743127:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743133:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743138:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743144:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743165:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743173:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743179:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743184:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743189:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743226:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743233:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743238:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743253:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743259:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743264:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743270:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743276:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743282:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743288:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743293:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743298:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743304:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743309:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743315:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743321:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743327:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743332:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743348:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743354:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743359:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743364:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743369:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743375:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743380:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743386:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743391:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743397:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743402:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743407:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743412:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743417:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743422:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743427:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743432:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743437:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743442:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743447:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743455:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743460:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743465:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743471:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743476:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743482:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743492:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743506:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743512:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743518:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.743524:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599686.748524:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96b24334fc00:18613] 0 exiting: rc = 1 00000100:00100000:0.0:1787599686.748662:0:18614:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96b3812ed000:18614] 1 exiting: rc = 0 00000100:00100000:3.0:1787599686.749020:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749027:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749033:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749038:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749043:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749048:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749054:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749059:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749067:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749086:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749092:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749099:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749104:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749109:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749114:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749120:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749124:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749129:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749134:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749138:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749143:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749148:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749153:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749157:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749163:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749168:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749173:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749178:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749183:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749188:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749193:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749206:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749213:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749218:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749223:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749228:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749232:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749237:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749243:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749248:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749253:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749258:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749264:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749277:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749289:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749293:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749298:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749304:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749311:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749316:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749322:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749327:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749333:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749341:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749346:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749354:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749359:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749364:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749370:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749375:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749380:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749385:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749391:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787599686.749396:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787599686.750566:0:18615:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96b344a80200:18615] 0 exiting: rc = 1 00000100:00100000:0.0:1787599686.750932:0:18616:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96b24230f400:18616] 1 exiting: rc = 0 00000100:00100000:2.0:1787599686.751106:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751115:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751121:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751127:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751133:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751156:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751163:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751169:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751176:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751182:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751187:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751193:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751211:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751217:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751222:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751227:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751233:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751252:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751259:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751265:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751270:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751276:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751281:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751286:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751302:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751308:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751314:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751320:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751326:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751344:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751350:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751355:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751360:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751366:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751370:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751375:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751381:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751386:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751392:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751397:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751403:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751420:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751426:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751431:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751437:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751442:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751447:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751453:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751458:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751463:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751467:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751472:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751477:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751493:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751499:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751505:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751510:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751515:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751521:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751533:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751538:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751544:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751549:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787599686.751561:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787599686.769101:0:21274:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787599708.771449:0:22038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787599722.631295:0:22639:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787599722.631303:0:22639:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787599722.631304:0:22639:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787599722.631569:0:22639:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b344b34800 00000020:01000004:2.0:1787599722.631585:0:22639:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787599722.631593:0:22639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787599722.631609:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff96b344af8000) 00000020:00000080:2.0:1787599722.631624:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787599722.778665:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787599722.783926:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787599722.784516:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.785244:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.785753:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787599722.786164:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.786329:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787599722.787109:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787599722.787345:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787599722.787541:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.787726:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.788021:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787599722.788284:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787599722.788554:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.792372:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.793308:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.793510:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.793713:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.793959:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.794490:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.794688:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.795367:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.795584:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.795787:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.796203:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.796388:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.796571:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.796759:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.797219:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.797453:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.797686:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.797919:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.798546:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.798876:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.799363:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.799596:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.799927:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.800444:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.800670:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.800898:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.801235:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.801642:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.801901:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.802374:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.802592:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.802829:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787599722.803036:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787599722.803977:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.804461:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.804680:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.805304:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.805488:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787599722.805773:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1787599722.806689:0:22639:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787599722.807044:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787599722.807074:0:22639:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599722.807085:0:22639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0c2f 00000020:01000004:2.0:1787599722.807092:0:22639:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787599722.807097:0:22639:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787599722.807102:0:22639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b344b34800 from MGS 00000020:01000004:2.0:1787599722.807107:0:22639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787599722.807118:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96b344af99b8) 00000020:00000080:2.0:1787599722.807128:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787599722.807188:0:22639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b344b34800 from MGS, refs=2 00080000:01000000:2.0:1787599722.807193:0:22639:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599722.807197:0:22639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0c3d 00000100:00100000:2.0:1787599722.807309:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787599722.807439:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787599722.807446:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787599722.808473:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787599722.808483:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787599722.809234:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599722.809408:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787599722.809414:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787599722.810360:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787599722.810369:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787599722.810859:0:22639:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787599722.810866:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787599722.811689:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599722.811693:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599722.811695:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599722.812480:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599722.812484:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599722.812486:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599722.813333:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787599722.815969:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787599722.818340:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787599722.821820:0:22651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787599722.821986:0:22639:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787599722.822133:0:22639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787599722.826244:0:22639:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787599722.826582:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599722.826772:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787599722.826778:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787599722.830467:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787599722.831396:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787599722.831825:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787599722.831834:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787599722.832645:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787599722.832669:0:22639:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.101@tcp' 00000020:01000004:3.0:1787599722.832671:0:22639:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787599722.832707:0:22639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.101@tcp (typ=mgc) 00000020:00000080:3.0:1787599722.832721:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.101@tcp (ffff96b345e08000) 00000020:00000080:3.0:1787599722.832772:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787599722.833032:0:22639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b34e5bf000@MGC192.168.202.101@tcp: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599722.833278:0:22639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.101@tcp-0 is initialized 00000040:01000000:3.0:1787599722.833297:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787599722.833531:0:22656:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787599722.833970:0:22657:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787599722.834000:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.101@tcp (uuid 559ac968-b0ab-4af8-8146-7f269e4a29a3) 00000020:00000080:3.0:1787599722.834016:0:22639:0:(genops.c:1385:class_connect()) connect: client 559ac968-b0ab-4af8-8146-7f269e4a29a3, cookie 0x5d2988b0929d0c4b 00000100:00080000:3.0:1787599722.834027:0:22639:0:(import.c:510:import_select_connection()) MGC192.168.202.101@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599722.834032:0:22639:0:(import.c:624:import_select_connection()) MGC192.168.202.101@tcp: import ffff96b34e5bf000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599722.834218:0:22639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0f100 x1874433578073600/t0(0) o250->MGC192.168.202.101@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599722.834257:0:22639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 559ac968-b0ab-4af8-8146-7f269e4a29a3->MGS 00000020:01000004:3.0:1787599722.834277:0:22639:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787599722.834303:0:22639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787599722.834329:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96b345e0b370) 00000020:00000080:3.0:1787599722.834354:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787599722.834564:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:559ac968-b0ab-4af8-8146-7f269e4a29a3:3644:1874433578073600:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787599722.834635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599722.838996:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578073600 00000100:00100000:2.0:1787599722.839012:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578073600 00000100:00100000:2.0:1787599722.841598:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599722.841613:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1874433578073600:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787599722.841648:0:22653:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 559ac968-b0ab-4af8-8146-7f269e4a29a3@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:2.0:1787599722.841685:0:22653:0:(genops.c:1385:class_connect()) connect: client 559ac968-b0ab-4af8-8146-7f269e4a29a3, cookie 0x5d2988b0929d0c59 00000100:00080000:2.0:1787599722.841843:0:22653:0:(import.c:65:import_set_state_nolock()) ffff96b344b37800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599722.841982:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+5:3644:x1874433578073600:12345-0@lo:250:mount.lustre.0 Request processed in 370us (7345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599722.841991:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599722.842983:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.101@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787599722.842996:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.101@tcp: connect to target with instance 0 00000100:00080000:2.0:1787599722.843004:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.101@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787599722.843009:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787599722.843013:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34e5bf000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787599722.843016:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787599722.843030:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787599722.843038:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:559ac968-b0ab-4af8-8146-7f269e4a29a3:3644:1874433578073600:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787599722.858963:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599722.859196:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787599722.859203:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787599722.866189:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599722.866210:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787599722.866602:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599722.866609:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787599722.867276:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599722.867459:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787599722.867465:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787599722.868276:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787599722.868286:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787599722.913355:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787599722.913674:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787599722.913682:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787599722.914780:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787599722.914972:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787599722.924640:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599722.924870:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599722.924876:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787599722.925677:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599722.925686:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787599722.926205:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787599722.926377:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787599722.926382:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787599722.929400:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599722.929423:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787599722.930276:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599722.930454:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787599722.930460:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787599722.931234:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787599722.931244:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787599722.953235:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599722.953464:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599722.953472:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787599722.955386:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787599722.955404:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787599722.956375:0:22639:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599722.956387:0:22639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787599722.957345:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787599722.957375:0:22639:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787599722.957388:0:22639:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787599722.957505:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599722.957654:0:22639:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787599722.957659:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599722.957661:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599722.957662:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599722.957664:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599722.957665:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599722.957667:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599722.957668:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599722.957670:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599722.957672:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599722.957674:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599722.957677:0:22639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787599722.957679:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599722.957680:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787599722.957681:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599722.957682:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599722.957683:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599722.957684:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599722.957686:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787599722.957687:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787599722.957688:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599722.957689:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599722.957722:0:22639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787599722.957743:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599722.958174:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599722.958251:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599722.958310:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578073728 00000100:00100000:1.0:1787599722.958319:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578073728 00000100:00100000:1.0:1787599722.958403:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787599722.958413:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+5:22639:x1874433578073728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787599722.958454:0:22655:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787599722.958457:0:22655:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787599722.958460:0:22655:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787599722.958979:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787599722.959494:0:22655:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787599722.963295:0:22677:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787599722.963305:0:22677:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787599722.963309:0:22677:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787599722.963312:0:22677:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787599722.963470:0:22677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787599722.968740:0:22655:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787599722.968757:0:22655:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787599722.970379:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+5:22639:x1874433578073728:12345-0@lo:253:mount.lustre.0 Request processed in 11955us (12193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599722.970402:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599722.970511:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599722.970525:0:22639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787599722.970528:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599722.970530:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787599722.970532:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599722.970533:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599722.970534:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599722.970535:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599722.970537:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599722.970538:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787599722.970540:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599722.970541:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787599722.970600:0:22639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b344b34800 from lustre-MDT0000 10000000:01000000:3.0:1787599722.970631:0:22639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787599722.970634:0:22639:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787599722.970638:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96b345e08000 10000000:01000000:3.0:1787599722.970642:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599722.970649:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96b345e08000 from 1 10000000:01000000:3.0:1787599722.970652:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787599722.970688:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599722.970713:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599722.970723:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599722.970744:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599722.970782:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599722.970859:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef780 going to sleep for 11 seconds 00000100:00100000:2.0:1787599722.970951:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578073856 00000100:00100000:2.0:1787599722.970958:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578073856 00000100:00100000:2.0:1787599722.971000:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599722.971009:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+5:22639:x1874433578073856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599722.971022:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599722.971035:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7200/0x5d2988b0929d0c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0c60 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599722.971126:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7200/0x5d2988b0929d0c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0c60 expref: 6 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599722.971144:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7200/0x5d2988b0929d0c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0c60 expref: 6 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599722.971154:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7200, rc 0) 00000100:00100000:2.0:1787599722.971190:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+6:22639:x1874433578073856:12345-0@lo:101:mount.lustre.0 Request processed in 181us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599722.971196:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599722.971283:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599722.971296:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.971312:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599722.971367:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599722.971392:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599722.971422:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358e159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599722.971466:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578073984 00000100:00100000:1.0:1787599722.971470:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578073984 00000100:00100000:1.0:1787599722.971500:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599722.971507:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+6:22639:x1874433578073984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599722.971647:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+6:22639:x1874433578073984:12345-0@lo:501:mount.lustre.0 Request processed in 140us (253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787599722.971653:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599722.971832:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578073984:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787599722.971859:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787599722.971868:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.971876:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599722.971893:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b344b34800 10000000:01000000:0.0:1787599722.971898:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787599722.971903:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b344b34800 10000000:01000000:0.0:1787599722.971905:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787599722.971908:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b344b34800 from 1 10000000:01000000:0.0:1787599722.971910:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787599722.971929:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.971936:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.971944:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599722.971963:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074112:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599722.971990:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599722.972006:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358e159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599722.972186:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074112 00000100:00100000:1.0:1787599722.972191:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074112 00000100:00100000:1.0:1787599722.972214:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599722.972221:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+6:22639:x1874433578074112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599722.972229:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599722.972243:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54a600/0x5d2988b0929d0c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0c6e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.972259:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54a600/0x5d2988b0929d0c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0c6e expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.972268:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54a600/0x5d2988b0929d0c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0c6e expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.972316:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a600, rc 0) 00000100:00100000:1.0:1787599722.972352:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+7:22639:x1874433578074112:12345-0@lo:101:mount.lustre.0 Request processed in 132us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599722.972357:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599722.972499:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599722.972510:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c75 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.972519:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0c75 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599722.972531:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787599722.972644:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c75 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.972653:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c000/0x5d2988b0929d0c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c75 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599722.972658:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787599722.972662:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599722.972668:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b344b34800 10000000:01000000:0.0:1787599722.972670:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787599722.972673:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787599722.972675:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787599722.972690:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.972697:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599722.972713:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599722.972728:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599722.972757:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599722.972828:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358e159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599722.974719:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074240 00000100:00100000:1.0:1787599722.974740:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074240 00000100:00100000:1.0:1787599722.974841:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787599722.974852:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+7:22639:x1874433578074240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599722.974872:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599722.974910:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54a400/0x5d2988b0929d0c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0c7c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.974939:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54a400/0x5d2988b0929d0c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0c7c expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.974950:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54a400/0x5d2988b0929d0c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0c7c expref: 8 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599722.974958:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a400, rc 0) 00000100:00100000:1.0:1787599722.975038:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+8:22639:x1874433578074240:12345-0@lo:101:mount.lustre.0 Request processed in 188us (2279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599722.975168:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599722.975186:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c83 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599722.975195:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0c83 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599722.975274:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599722.975311:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599722.975350:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599722.975375:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074368 00000100:00100000:3.0:1787599722.975378:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074368 00000100:00100000:1.0:1787599722.975408:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599722.979126:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599722.979153:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+8:22639:x1874433578074368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599722.979674:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22639:x1874433578074368:12345-0@lo:501:mount.lustre.0 Request processed in 531us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599722.991357:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599722.991448:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599722.993878:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599722.994045:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599722.994138:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358e15300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599722.999076:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074496 00000100:00100000:2.0:1787599722.999094:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074496 00000100:00100000:2.0:1787599722.999178:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787599722.999192:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22639:x1874433578074496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599723.001328:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22639:x1874433578074496:12345-0@lo:503:mount.lustre.0 Request processed in 2129us (7274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.001344:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599723.001479:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578074496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599723.006976:0:22678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22678:1874433578074624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599723.007069:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.007133:0:22678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599723.007134:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074624 00000100:00100000:0.0:1787599723.007143:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074624 00000100:00100000:0.0:1787599723.007201:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599723.007213:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22678:x1874433578074624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787599723.008107:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22678:x1874433578074624:12345-0@lo:502:llog_process_th.0 Request processed in 891us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599723.008118:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599723.008222:0:22678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22678:1874433578074624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599723.008312:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.008325:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.008328:0:22678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787599723.008334:0:22678:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787599723.008338:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599723.008350:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96b345e0cd28) 00000020:00000080:3.0:1787599723.008366:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787599723.008371:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787599723.008524:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787599723.008532:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0c91 00000020:00000080:3.0:1787599723.008751:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787599723.008756:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599723.008759:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.008761:0:22678:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787599723.008764:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.008768:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.008769:0:22678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787599723.008772:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599723.008780:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96b345e099b8) 00000020:00000080:3.0:1787599723.008822:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787599723.008828:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787599723.008830:0:22678:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787599723.008833:0:22678:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787599723.008838:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787599723.008895:0:22678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b344b34800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787599723.010338:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96b3706f3370) 00000020:00000080:3.0:1787599723.010362:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787599723.010644:0:22678:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787599723.010653:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0ca6 00000020:00000080:3.0:1787599723.010790:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787599723.010832:0:22678:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787599723.010836:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d2988b0929d0cad 00080000:01000000:3.0:1787599723.010843:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787599723.010847:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0cb4 00010000:00010000:2.0:1787599723.137758:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787599723.138437:0:22678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1787599723.142283:0:22678:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787599723.143809:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96b344afcd28) 00000020:00000080:2.0:1787599723.143832:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787599723.143953:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599723.143962:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0cc2 00000020:00000080:3.0:1787599723.146975:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787599723.154361:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d2988b0929d0cc9 00000020:00000080:2.0:1787599723.158384:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787599723.158400:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.158408:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.158410:0:22678:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787599723.158414:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599723.158417:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787599723.158433:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599723.158435:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599723.158436:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599723.158439:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.158441:0:22678:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599723.158444:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599723.158449:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.158451:0:22678:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787599723.158455:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787599723.158516:0:22678:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787599723.158539:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.158557:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.158559:0:22678:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787599723.158562:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599723.158566:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.158568:0:22678:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787599723.158571:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599723.158577:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:2.0:1787599723.158607:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599723.158624:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff96b344afb370) 00000020:00000080:2.0:1787599723.158642:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787599723.158647:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599723.158709:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787599723.158716:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787599723.158722:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0cd7 00010000:00080000:2.0:1787599723.158775:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3707b4800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599723.160456:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787599723.164568:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787599723.164585:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787599723.164625:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787599723.164650:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0cde 00000100:00080000:3.0:1787599723.164661:0:22678:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599723.164667:0:22678:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599723.164707:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0c000 x1874433578074752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599723.164740:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787599723.164834:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599723.164839:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.164841:0:22678:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787599723.164844:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787599723.164847:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787599723.164848:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787599723.164850:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787599723.164851:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787599723.164854:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.164855:0:22678:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787599723.164857:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599723.164862:0:22678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787599723.164865:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.164867:0:22678:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787599723.164893:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787599723.164897:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:3.0:1787599723.164924:0:22678:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787599723.164927:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599723.164938:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96b3706f19b8) 00000020:00000080:3.0:1787599723.164949:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787599723.164953:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787599723.165031:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787599723.165039:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787599723.165198:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0cec 00010000:00080000:3.0:1787599723.165235:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3707b3000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599723.165441:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787599723.166464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578074752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599723.166561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599723.166663:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578074752 00000100:00100000:1.0:1787599723.166672:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578074752 00000100:00100000:1.0:1787599723.166715:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599723.166732:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578074752:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787599723.166752:0:22665:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787599723.167341:0:22678:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787599723.168732:0:22678:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787599723.171176:0:22678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599723.171401:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787599723.194490:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1787599723.194953:0:22684:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787599723.194958:0:22684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787599723.196492:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599723.196505:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599723.196544:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599723.196569:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0cf3 00000100:00080000:2.0:1787599723.196580:0:22678:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599723.196587:0:22678:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b3707b3000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599723.196627:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ad880 x1874433578074880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599723.196655:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599723.196722:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.196727:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.196729:0:22678:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599723.196732:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599723.196735:0:22678:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787599723.196736:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599723.196738:0:22678:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599723.196740:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599723.196742:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.196744:0:22678:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599723.196746:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599723.196750:0:22678:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787599723.196753:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.196754:0:22678:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787599723.196757:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599723.196760:0:22678:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1787599723.196783:0:22678:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787599723.196786:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599723.196821:0:22678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96b3707b99b8) 00000020:00000080:2.0:1787599723.196830:0:22678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787599723.196834:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599723.196875:0:22678:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787599723.196889:0:22678:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787599723.196895:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d2988b0929d0d01 00010000:00080000:2.0:1787599723.196933:0:22678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b24442c800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.101@tcp at head 00000100:00100000:0.0:1787599723.196988:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578074880:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787599723.197045:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578074880 offset 0 length 520: 4 00000100:00100000:1.0:1787599723.197922:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578074752:12345-0@lo:38:llog_process_th.0 Request processed in 31184us (31356us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787599723.197934:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787599723.198183:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787599723.198189:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787599723.198193:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578074752:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787599723.198216:0:22678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787599723.198301:0:22678:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787599723.198317:0:22678:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787599723.201349:0:22678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599723.201701:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787599723.205116:0:22678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1787599723.205697:0:22686:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787599723.205703:0:22686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787599723.206990:0:22678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787599723.207007:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599723.207117:0:22678:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787599723.207146:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0d08 00000100:00080000:2.0:1787599723.207157:0:22678:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599723.207164:0:22678:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599723.207220:0:22678:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433aea00 x1874433578075008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599723.207287:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578075008:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787599723.207343:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578075008 offset 0 length 520: 4 00000100:00080000:2.0:1787599723.207401:0:22678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787599723.207469:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.207473:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.207475:0:22678:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787599723.207478:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599723.207483:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.207484:0:22678:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599723.207487:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599723.207489:0:22678:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787599723.207491:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.207493:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.207495:0:22678:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787599723.207496:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599723.207499:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.207500:0:22678:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787599723.207503:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787599723.207535:0:22678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22678:1874433578075136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.207594:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599723.207623:0:22678:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2423b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599723.207761:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075136 00000100:00100000:3.0:1787599723.207769:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075136 00000100:00100000:3.0:1787599723.207854:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599723.207866:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22678:x1874433578075136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599723.208010:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22678:x1874433578075136:12345-0@lo:502:llog_process_th.0 Request processed in 145us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599723.208019:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599723.208239:0:22678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22678:1874433578075136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599723.208266:0:22678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.208271:0:22678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.208273:0:22678:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787599723.208276:0:22678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787599723.208450:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787599723.208475:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787599723.208500:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c83 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.208513:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c200/0x5d2988b0929d0c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c83 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599723.208534:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b344b34800 from 1 10000000:01000000:3.0:1787599723.208538:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787599723.208569:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.208576:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.208586:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599723.208600:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599723.208637:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.208671:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599723.208733:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075264 00000100:00100000:1.0:1787599723.208740:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075264 00000100:00100000:1.0:1787599723.208770:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599723.208776:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+9:22639:x1874433578075264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599723.208786:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599723.208835:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d0f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.208858:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.208869:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.208877:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a000, rc 0) 00000100:00100000:1.0:1787599723.208924:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+10:22639:x1874433578075264:12345-0@lo:101:mount.lustre.0 Request processed in 147us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599723.208930:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787599723.209180:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599723.209194:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.209204:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599723.209769:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075392:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787599723.210110:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.210179:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef840 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.210349:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075392 00000100:00100000:2.0:1787599723.210356:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075392 00000100:00100000:2.0:1787599723.210435:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599723.210445:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+10:22639:x1874433578075392:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787599723.210464:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787599723.210471:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787599723.210555:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+10:22639:x1874433578075392:12345-0@lo:256:mount.lustre.0 Request processed in 111us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.210563:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599723.210624:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075392:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787599723.211263:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787599723.211296:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.211306:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599723.211314:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b344b34800 from 1 10000000:01000000:3.0:1787599723.211317:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599723.211347:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.211354:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.211364:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599723.211384:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599723.211422:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.211971:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599723.212114:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075520 00000100:00100000:1.0:1787599723.212123:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075520 00000100:00100000:1.0:1787599723.212165:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599723.212187:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+10:22639:x1874433578075520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599723.212201:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599723.212220:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d1d expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.212247:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.212257:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599723.212268:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54b200, rc 0) 00000100:00100000:1.0:1787599723.212326:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578075520:12345-0@lo:101:mount.lustre.0 Request processed in 143us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599723.212334:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599723.212476:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599723.212492:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599723.212502:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599723.212571:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599723.212600:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.212637:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599723.212689:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075648 00000100:00100000:1.0:1787599723.212693:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075648 00000100:00100000:1.0:1787599723.212711:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599723.212717:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578075648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599723.212984:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578075648:12345-0@lo:501:mount.lustre.0 Request processed in 266us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599723.212991:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599723.213252:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599723.213284:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599723.213326:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.213354:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781ef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787599723.213404:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075776 00000100:00100000:1.0:1787599723.213409:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075776 00000100:00100000:1.0:1787599723.213442:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599723.213449:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578075776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599723.213539:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578075776:12345-0@lo:503:mount.lustre.0 Request processed in 90us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599723.213555:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787599723.213662:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578075776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599723.214447:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22688:1874433578075904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599723.214500:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.214536:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599723.214600:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578075904 00000100:00100000:1.0:1787599723.214607:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578075904 00000100:00100000:1.0:1787599723.214645:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599723.214654:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22688:x1874433578075904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787599723.215245:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22688:x1874433578075904:12345-0@lo:502:llog_process_th.0 Request processed in 591us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599723.215252:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599723.215339:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22688:1874433578075904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787599723.215368:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.215379:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215381:0:22688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787599723.215388:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b344b34800 00000020:00000080:3.0:1787599723.215390:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599723.215398:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599723.215401:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215402:0:22688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787599723.215405:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.215407:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215408:0:22688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787599723.215411:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b344b34800 00000020:00000080:3.0:1787599723.215413:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599723.215475:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599723.215479:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215480:0:22688:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787599723.215482:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.215485:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215486:0:22688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599723.215496:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b344b34800 00000020:00000080:3.0:1787599723.215498:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599723.215518:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599723.215520:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215522:0:22688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599723.215524:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599723.215526:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599723.215528:0:22688:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787599723.215531:0:22688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b344b34800 00000020:00000080:3.0:1787599723.215533:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787599723.215568:0:22688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22688:1874433578076032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787599723.215602:0:22688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599723.215635:0:22688:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.215679:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076032 00000100:00100000:2.0:1787599723.215685:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076032 00000100:00100000:2.0:1787599723.215723:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599723.215731:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22688:x1874433578076032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.215843:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22688:x1874433578076032:12345-0@lo:502:llog_process_th.0 Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.215850:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787599723.215898:0:22688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22688:1874433578076032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787599723.215915:0:22688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599723.215920:0:22688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599723.215926:0:22688:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787599723.215930:0:22688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787599723.219873:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787599723.219927:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599723.219957:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.219970:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599723.220046:0:22639:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599723.220050:0:22639:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b344b34800 10000000:01000000:0.0:1787599723.220053:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b344b34800 10000000:01000000:0.0:1787599723.220058:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599723.220064:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b344b34800 from 1 10000000:01000000:0.0:1787599723.220066:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599723.220121:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.220131:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.220145:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599723.220175:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599723.220252:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.220299:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351a9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.222194:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076160 00000100:00100000:2.0:1787599723.222208:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076160 00000100:00100000:2.0:1787599723.222270:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599723.222281:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22639:x1874433578076160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599723.222299:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599723.222317:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929d0d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d2b expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599723.222346:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929d0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d2b expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599723.222357:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7a00/0x5d2988b0929d0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d2b expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599723.222368:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7a00, rc 0) 00000100:00100000:2.0:1787599723.222456:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578076160:12345-0@lo:101:mount.lustre.0 Request processed in 176us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.222464:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787599723.224437:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599723.224489:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d32 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.224503:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d32 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599723.224629:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599723.224704:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.224752:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351a9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599723.224776:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076288 00000100:00100000:0.0:1787599723.224782:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076288 00000100:00100000:0.0:1787599723.224856:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599723.224866:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578076288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599723.225017:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578076288:12345-0@lo:501:mount.lustre.0 Request processed in 151us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599723.225024:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599723.225504:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599723.225538:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599723.227967:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.230990:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351a9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.236825:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076416 00000100:00100000:2.0:1787599723.236845:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076416 00000100:00100000:2.0:1787599723.236965:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599723.236976:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578076416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599723.237874:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578076416:12345-0@lo:503:mount.lustre.0 Request processed in 894us (9912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.237896:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787599723.238554:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578076416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599723.239363:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.240257:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599723.240302:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076544 00000100:00100000:2.0:1787599723.240309:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076544 00000100:00100000:2.0:1787599723.240347:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599723.240356:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.240960:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076544:12345-0@lo:502:llog_process_th.0 Request processed in 603us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.240969:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599723.241021:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813ef300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.241046:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076544:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787599723.242498:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787599723.242520:0:22693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96b3707bcd28) 00000020:00000080:2.0:1787599723.242546:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787599723.242676:0:22693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b344b34800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599723.243500:0:22693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b344b34800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787599723.243509:0:22693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b344b34800 4 00010000:00080000:2.0:1787599723.243577:0:22693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b34631f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599723.251525:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787599723.252167:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787599723.252216:0:22693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599723.252232:0:22693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d2988b0929d0d40 00000100:00080000:2.0:1787599723.252244:0:22693:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599723.252250:0:22693:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96b34631f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599723.252291:0:22693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ac000 x1874433578076672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599723.252324:0:22693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787599723.253291:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578076672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599723.253369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599723.253612:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.253674:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599723.253705:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076800 00000100:00100000:2.0:1787599723.253712:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076800 00000100:00100000:2.0:1787599723.253755:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599723.253766:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.253926:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076800:12345-0@lo:502:llog_process_th.0 Request processed in 160us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.253935:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787599723.253978:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3813eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.254002:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.254045:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.254077:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599723.254099:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076928 00000100:00100000:2.0:1787599723.254102:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076928 00000100:00100000:2.0:1787599723.254122:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599723.254128:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787599723.254184:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22693:x1874433578076928:12345-0@lo:502:llog_process_th.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.254191:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787599723.254219:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2421deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.254232:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:559ac968-b0ab-4af8-8146-7f269e4a29a3:22693:1874433578076928:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787599723.254251:0:22693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1787599723.255043:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578076672 00000100:00100000:1.0:1787599723.255050:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578076672 00000100:00100000:1.0:1787599723.255078:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599723.255085:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578076672:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599723.255174:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578076672:12345-0@lo:38:llog_process_th.0 Request processed in 88us (1805us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787599723.255181:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599723.255221:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599723.255228:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599723.255232:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787599723.255236:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578076672:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787599723.263516:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787599723.263567:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599723.264206:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d32 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.264235:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d000/0x5d2988b0929d0d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d32 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599723.264290:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599723.264292:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599723.264294:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599723.264295:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599723.264296:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599723.264297:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599723.264299:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599723.264300:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599723.264302:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599723.264303:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599723.264307:0:22639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787599723.264309:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599723.264310:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787599723.264312:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599723.264313:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599723.264314:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599723.264315:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599723.264316:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787599723.264317:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787599723.264317:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599723.264318:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599723.264345:0:22639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787599723.264367:0:22639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578077056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599723.264513:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.264783:0:22639:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351a9fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599723.266523:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077056 00000100:00100000:2.0:1787599723.266540:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077056 00000100:00100000:2.0:1787599723.266600:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787599723.266624:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578077056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599723.266665:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787599723.266681:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787599723.271847:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787599723.271870:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787599723.272242:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22639:x1874433578077056:12345-0@lo:253:mount.lustre.0 Request processed in 5616us (7723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599723.272256:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:0.0:1787599723.272340:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599723.272344:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599723.272366:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272380:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272475:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272515:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272531:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 11 pid: 22653 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599723.272545:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578077184:0@lo:104: 00000100:00100000:0.0:1787599723.272584:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.272622:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358e159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599723.272662:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077184 00000100:00100000:0.0:1787599723.272670:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077184 00000100:00100000:0.0:1787599723.272709:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599723.272719:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578077184:12345-0@lo:104: 00010000:00010000:0.0:1787599723.272733:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272779:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599723.272785:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578077184:12345-0@lo:104: Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599723.272826:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787599723.272847:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599723.272853:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272860:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599723.272872:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272890:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599723.272898:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599723.272905:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599723.272940:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272947:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599723.272967:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272974:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d16 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.272989:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599723.272991:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599723.272993:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599723.273022:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578077312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599723.279360:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578077184:0@lo:104: 00010000:00010000:1.0:1787599723.279392:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599723.279458:0:22639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:22639:1874433578077056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787599723.279470:0:22639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787599723.279473:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599723.279475:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787599723.279476:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599723.279478:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599723.279479:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599723.279480:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599723.279482:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787599723.279483:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787599723.279485:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599723.279487:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787599723.279498:0:22639:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787599723.285510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599723.285671:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077312 00000100:00100000:0.0:1787599723.285683:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077312 00010000:00010000:0.0:1787599723.285728:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 12 pid: 22653 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599723.285763:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599723.285779:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3645:x1874433578077312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599723.285824:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599723.285831:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 12 pid: 22653 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285846:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 12 pid: 22653 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285868:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d0d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0d0f expref: 12 pid: 22653 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285895:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285904:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599723.285921:0:22645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013577406s 00010000:00010000:0.0:1787599723.285927:0:22645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285934:0:22645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285942:0:22645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285949:0:22645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285955:0:22645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3de00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599723.285966:0:22645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285975:0:22645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.285991:0:22645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.286004:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599723.288756:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:3645:x1874433578077312:12345-0@lo:103:ldlm_bl.0 Request processed in 2971us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599723.288771:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787599723.288862:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.288872:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599723.288890:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0d47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599723.288942:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578077312:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787599723.314970:0:22639:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1787599723.315569:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787599723.315905:0:22700:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1787599723.315911:0:22700:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1787599723.316085:0:22701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787599723.316774:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787599723.320521:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787599723.323774:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787599723.323901:0:22701:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1787599723.324493:0:22702:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96b377b0dc00 x1874433578077440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599723.324505:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000040:01000000:2.0:1787599723.325334:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787599723.325377:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787599723.326328:0:22639:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787599723.326342:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787599723.326468:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599723.328248:0:22639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787599723.329087:0:22639:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787599723.329150:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787599723.330262:0:22639:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787599723.331350:0:22639:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787599723.334137:0:22639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787599723.336352:0:22639:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787599723.336469:0:22639:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb14417ab988 00100000:10000000:2.0:1787599723.336479:0:22639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787599723.338378:0:22639:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787599723.338898:0:22639:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787599723.338921:0:22639:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787599723.338949:0:22639:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787599723.342063:0:22639:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599723.344018:0:22639:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599723.880933:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599724.325352:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000040:00080000:1.0:1787599724.328330:0:22695:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787599724.328341:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787599724.341580:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787599724.341596:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1787599724.472432:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599724.472442:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b344b34800 from 11 10000000:01000000:0.0:1787599724.472448:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599724.472510:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599724.472528:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599724.472541:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599724.472569:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578077568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599724.472654:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599724.472716:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599724.472875:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077568 00000100:00100000:1.0:1787599724.472885:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077568 00000100:00100000:1.0:1787599724.472979:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599724.472993:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+11:22657:x1874433578077568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599724.473009:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599724.473025:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d4e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599724.473051:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599724.473073:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599724.473083:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ba00, rc 0) 00000100:00100000:1.0:1787599724.473129:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22657:x1874433578077568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599724.473135:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599724.473921:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578077568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599724.473942:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599724.473953:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599724.474010:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578077696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787599724.474059:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599724.474094:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599724.474186:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077696 00000100:00100000:2.0:1787599724.474193:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077696 00000100:00100000:2.0:1787599724.474236:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599724.474251:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22657:x1874433578077696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787599724.474274:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599724.474293:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599724.474296:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787599724.474383:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:22657:x1874433578077696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599724.474557:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578077696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787599724.474598:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599724.474606:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599724.474615:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599724.474669:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787599724.900982:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599725.351177:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000040:00080000:0.0:1787599725.352219:0:22695:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787599725.352227:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599725.352343:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787599725.352373:0:22695:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599725.352495:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1787599725.927072:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599726.388537:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:0.0:1787599726.948965:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599727.403701:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599727.973276:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599728.422208:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000100:00080000:2.0:1787599728.680685:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787599728.680692:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787599728.680696:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599728.680704:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1787599728.680711:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599728.680718:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599728.680740:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433af800 x1874433578077952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599728.680768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599728.680772:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599728.680775:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599728.680777:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599728.680780:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787599728.680782:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787599728.680784:0:36:0:(import.c:65:import_set_state_nolock()) ffff96b34631f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599728.680849:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96b34631f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599728.680863:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ace00 x1874433578078080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787599728.681115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578077824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599728.681208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599728.681938:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578077952:0@lo:38:kworker.0 00000100:00100000:0.0:1787599728.682041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599728.682066:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578078080:0@lo:38:kworker.0 00000100:00100000:0.0:1787599728.682095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599728.682163:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077952 00000100:00100000:0.0:1787599728.682171:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077952 00000100:00100000:0.0:1787599728.682202:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599728.682209:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578077952:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787599728.682227:0:22666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787599728.682263:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578077952:12345-0@lo:38:kworker.0 Request processed in 54us (222us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787599728.682270:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787599728.682307:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787599728.682311:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787599728.682315:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578077952:0@lo:38:kworker.0 00000100:00100000:2.0:1787599728.683935:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077824 00000100:00100000:2.0:1787599728.683950:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077824 00000100:00100000:2.0:1787599728.684105:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599728.684116:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3646:x1874433578077824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599728.684208:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3646:x1874433578077824:12345-0@lo:400:kworker.0 Request processed in 95us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599728.684216:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787599728.684877:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578077824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599728.686482:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078080 00000100:00100000:0.0:1787599728.686497:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078080 00000100:00100000:0.0:1787599728.686543:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599728.686552:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578078080:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787599728.686591:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:0.0:1787599728.686633:0:22662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d2988b0929d0d5c 00000004:00100000:0.0:1787599728.686649:0:22662:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599728.686814:0:22662:0:(import.c:65:import_set_state_nolock()) ffff96b378219000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599728.686919:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1874433578078080:12345-0@lo:38:kworker.0 Request processed in 366us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599728.686927:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787599728.686978:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b2433ace00 x1874433578078080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787599728.687068:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787599728.687079:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787599728.687086:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787599728.687088:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b34631f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787599728.687095:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1874433578078080:0@lo:38:kworker.0 00010000:00010000:0.0:1787599728.999188:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599729.317713:0:22945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787599729.452629:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:3.0:1787599730.021579:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599730.471348:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000020:00000004:1.0:1787599730.659779:0:22997:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599730.665276:0:22997:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599731.048318:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599731.493005:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000020:00000004:0.0:1787599731.686292:0:23047:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599731.686490:0:23047:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787599732.069390:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599732.522328:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599733.099363:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599733.544332:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000100:00100000:1.0:1787599733.797936:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599723/real 1787599723] req@ffff96b2433aea00 x1874433578075008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599733.797968:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433aea00 x1874433578075008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599733.797979:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599723/real 1787599723] req@ffff96b2433ad880 x1874433578074880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599733 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599733.797990:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433ad880 x1874433578074880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599733 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599733.798009:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599733.798030:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599733.798041:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578075008:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787599733.798048:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599733.798054:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599733.798057:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578074880:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787599733.799617:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787599733.799625:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787599733.799629:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599733.799638:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 675 00000100:00080000:2.0:1787599733.799645:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787599733.799653:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599733.799679:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ad500 x1874433578078336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599733.799695:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599733.799698:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787599733.799700:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599733.799704:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1787599733.799706:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599733.799709:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b3707b3000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599733.799728:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ad180 x1874433578078464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599733.799737:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599733.799740:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599733.799742:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599733.799745:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1787599733.799747:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787599733.799751:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599733.799759:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ac700 x1874433578078592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599733.799943:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578078720:0@lo:400:kworker.0 00000100:00100000:1.0:1787599733.800009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599733.800074:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599733.800079:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578078208:0@lo:400:kworker.0 00000100:00100000:1.0:1787599733.800110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599733.800154:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078720 00000100:00100000:1.0:1787599733.800162:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078720 00000100:00100000:1.0:1787599733.800214:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599733.800225:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578078720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599733.800279:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578078720:12345-0@lo:400:kworker.0 Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599733.800287:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787599733.800313:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078336:0@lo:38:kworker.0 00000100:00100000:1.0:1787599733.800340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599733.800357:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078464:0@lo:8:kworker.0 00000400:00000100:1.0:1787599733.800377:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578078464 offset 0 length 520: 4 00000100:00100000:1.0:1787599733.800387:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078592:0@lo:8:kworker.0 00000400:00000100:1.0:1787599733.800401:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578078592 offset 0 length 520: 4 00000100:00100000:1.0:1787599733.800432:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078336 00000100:00100000:1.0:1787599733.800435:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078336 00000100:00100000:1.0:1787599733.800464:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599733.800468:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578078336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787599733.800485:0:22666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787599733.800514:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578078336:12345-0@lo:38:kworker.0 Request processed in 45us (173us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787599733.800521:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599733.800553:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b2433adc00 x1874433578078720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599733.800568:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578078720:0@lo:400:kworker.0 00000100:00080000:1.0:1787599733.800598:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599733.800603:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599733.800606:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078336:0@lo:38:kworker.0 00000100:00100000:3.0:1787599733.802085:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078208 00000100:00100000:3.0:1787599733.802102:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078208 00000100:00100000:3.0:1787599733.802160:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787599733.802173:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3648:x1874433578078208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599733.802284:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3648:x1874433578078208:12345-0@lo:400:kworker.0 Request processed in 114us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599733.802293:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599733.802364:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578078208:0@lo:400:kworker.0 00010000:00010000:1.0:1787599734.118084:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599734.565874:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599735.145471:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599735.589501:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599735.590717:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599736.165125:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599736.619320:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599737.189027:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599737.636876:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:3.0:1787599738.213426:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599738.661826:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000100:00080000:3.0:1787599738.932282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787599738.932289:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787599738.932293:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599738.932301:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:3.0:1787599738.932306:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599738.932312:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599738.932331:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0c000 x1874433578078976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599738.932345:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599738.932348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599738.932351:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599738.932354:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599738.933011:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578079104:0@lo:400:kworker.0 00000100:00100000:0.0:1787599738.933083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599738.933145:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599738.933167:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578078848:0@lo:400:kworker.0 00000100:00100000:0.0:1787599738.933199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599738.933243:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079104 00000100:00100000:0.0:1787599738.933252:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079104 00000100:00100000:0.0:1787599738.933295:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599738.933303:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578079104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599738.933354:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578079104:12345-0@lo:400:kworker.0 Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599738.933360:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599738.933419:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078848 00000100:00100000:0.0:1787599738.933424:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078848 00000100:00100000:0.0:1787599738.933453:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599738.933460:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3646:x1874433578078848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599738.933491:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:3646:x1874433578078848:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599738.933499:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599738.933549:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578078848:0@lo:400:kworker.0 00010000:00080000:0.0:1787599738.933562:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b377b0d500 x1874433578079104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599738.933571:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578079104:0@lo:400:kworker.0 00000100:00100000:1.0:1787599738.934414:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078976:0@lo:38:kworker.0 00000100:00100000:1.0:1787599738.934461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599738.934567:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578078976 00000100:00100000:3.0:1787599738.934573:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578078976 00000100:00100000:3.0:1787599738.934606:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599738.934612:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578078976:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787599738.934630:0:22666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787599738.935847:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1874433578078976:12345-0@lo:38:kworker.0 Request processed in 1227us (1379us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599738.935869:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787599738.938862:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599738.938875:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599738.938880:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078976:0@lo:38:kworker.0 00010000:00010000:0.0:1787599739.237905:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599739.686613:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00000020:01000004:0.0:1787599740.009385:0:23394:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787599740.009389:0:23394:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787599740.009391:0:23394:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787599740.009498:0:23394:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b37f896800 00000020:01000004:0.0:1787599740.009515:0:23394:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787599740.009528:0:23394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787599740.009548:0:23394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff96b242c399b8) 00000020:00000080:0.0:1787599740.009565:0:23394:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787599740.094414:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787599740.094700:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.096523:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.097078:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.097456:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.097745:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.098055:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.098391:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.098589:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.098925:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.099277:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.099521:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.099819:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787599740.100053:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787599740.102748:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.103226:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.103464:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.103709:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.104002:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.104298:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.104542:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.104902:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.105413:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.105714:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.105977:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.106337:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.106538:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.106875:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.107267:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.107504:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.107959:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.108303:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.108551:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.108943:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.109315:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.109562:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.109926:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.110781:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.111330:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.111585:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.111891:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.112235:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.112452:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787599740.112729:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.113036:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787599740.113376:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00080000:01000000:2.0:1787599740.114379:0:23394:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787599740.114611:0:23394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787599740.114622:0:23394:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599740.114633:0:23394:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0d6a 00000020:01000004:2.0:1787599740.114651:0:23394:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787599740.114674:0:23394:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599740.114678:0:23394:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599740.114684:0:23394:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787599740.114709:0:23394:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787599740.114714:0:23394:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787599740.119750:0:23394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787599740.119868:0:23394:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787599740.119874:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787599740.119876:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.119878:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.119879:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.119880:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.119882:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.119883:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.119885:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.119887:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599740.119890:0:23394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787599740.119893:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599740.119904:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.119905:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.119906:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.119908:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.119909:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.119910:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.119912:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.119913:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787599740.119942:0:23394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787599740.119962:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599740.120036:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.120090:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.120277:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079232 00000100:00100000:0.0:1787599740.120285:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079232 00000100:00100000:0.0:1787599740.120381:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787599740.120392:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:23394:x1874433578079232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787599740.120422:0:22654:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787599740.120426:0:22654:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787599740.120434:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787599740.120810:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:23394:x1874433578079232:12345-0@lo:253:mount.lustre.0 Request processed in 399us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.120819:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787599740.120928:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599740.120937:0:23394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787599740.120939:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599740.120941:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.120942:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.120943:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.120944:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.120945:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.120955:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.120957:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.120958:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787599740.120976:0:23394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b37f896800 from lustre-MDT0001 10000000:01000000:3.0:1787599740.121000:0:23394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787599740.121003:0:23394:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787599740.121008:0:23394:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b345e08000 local copy 00010000:00010000:3.0:1787599740.121017:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599740.121094:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599740.121144:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.121549:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.121610:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079360 00000100:00100000:2.0:1787599740.121615:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079360 00000100:00100000:2.0:1787599740.121655:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599740.121664:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:23394:x1874433578079360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.121750:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:23394:x1874433578079360:12345-0@lo:501:mount.lustre.0 Request processed in 87us (614us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599740.121757:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787599740.121925:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079360:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787599740.121939:0:23394:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787599740.121957:0:23394:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787599740.121963:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.121972:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.121997:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b37f896800 10000000:01000000:3.0:1787599740.122002:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787599740.122007:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96b345e08000 10000000:01000000:3.0:1787599740.122009:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787599740.122013:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96b345e08000 from 1 10000000:01000000:3.0:1787599740.122016:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787599740.122038:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122059:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122070:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599740.122085:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599740.122124:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.122289:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.122407:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079488 00000100:00100000:2.0:1787599740.122412:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079488 00000100:00100000:2.0:1787599740.122434:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599740.122440:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+12:23394:x1874433578079488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599740.122449:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599740.122462:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7600/0x5d2988b0929d0d78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d71 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.122490:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7600/0x5d2988b0929d0d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d71 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.122499:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7600/0x5d2988b0929d0d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d71 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.122507:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7600, rc 0) 00000100:00100000:2.0:1787599740.122546:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+13:23394:x1874433578079488:12345-0@lo:101:mount.lustre.0 Request processed in 105us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.122552:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787599740.122670:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599740.122682:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d78 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122690:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d78 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.122705:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787599740.122721:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d78 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122729:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200da00/0x5d2988b0929d0d71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d78 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.122746:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96b37f896800 10000000:01000000:3.0:1787599740.122750:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787599740.122753:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96b37f896800 from 1 10000000:01000000:3.0:1787599740.122755:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787599740.122776:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122784:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.122822:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599740.122837:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599740.122862:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.122877:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.123088:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079616 00000100:00100000:2.0:1787599740.123093:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079616 00000100:00100000:2.0:1787599740.123126:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599740.123133:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+13:23394:x1874433578079616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599740.123295:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599740.123305:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929d0d86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d7f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.123321:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929d0d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d7f expref: 14 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.123329:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7e00/0x5d2988b0929d0d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d7f expref: 14 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.123337:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7e00, rc 0) 00000100:00100000:2.0:1787599740.123377:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+14:23394:x1874433578079616:12345-0@lo:101:mount.lustre.0 Request processed in 244us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.123395:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787599740.123458:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599740.123469:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d86 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.123477:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d86 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.123487:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787599740.123502:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d86 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.123508:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200c800/0x5d2988b0929d0d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d86 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.123514:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787599740.123518:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599740.123523:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96b37f896800 10000000:01000000:3.0:1787599740.123531:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787599740.123535:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787599740.123537:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787599740.123551:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.123557:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.123564:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599740.123577:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599740.123602:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.123724:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599740.123872:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079744 00000100:00100000:1.0:1787599740.123878:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079744 00000100:00100000:2.0:1787599740.124017:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599740.124098:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+14:23394:x1874433578079744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599740.124116:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599740.124128:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200ca00/0x5d2988b0929d0d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0d8d expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.124152:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200ca00/0x5d2988b0929d0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0d8d expref: 15 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.124161:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200ca00/0x5d2988b0929d0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d8d expref: 15 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.124168:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ca00, rc 0) 00000100:00100000:3.0:1787599740.124206:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578079744:12345-0@lo:101:mount.lustre.0 Request processed in 181us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.124221:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599740.124387:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599740.124399:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d94 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.124407:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0d94 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599740.125774:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787599740.126535:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599740.130651:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787599740.130711:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787599740.130729:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787599740.130759:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787599740.130776:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787599740.130867:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787599740.130891:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787599740.130988:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787599740.131005:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787599740.131020:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787599740.131034:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787599740.131048:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787599740.131063:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787599740.131079:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787599740.131094:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787599740.131183:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787599740.131202:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787599740.131219:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787599740.131234:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787599740.131260:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787599740.131277:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787599740.131292:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787599740.131306:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787599740.131321:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787599740.131339:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787599740.131355:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787599740.131370:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787599740.131385:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787599740.131399:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787599740.131414:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787599740.131430:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787599740.131446:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787599740.131462:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787599740.131477:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787599740.131492:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787599740.131507:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787599740.131521:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787599740.131536:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787599740.131550:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787599740.131565:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787599740.131579:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787599740.131595:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787599740.131610:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787599740.131625:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787599740.131655:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787599740.131661:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787599740.131787:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.132079:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.132190:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.132236:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578079872 00000100:00100000:0.0:1787599740.132245:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578079872 00000100:00100000:0.0:1787599740.132286:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787599740.132295:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578079872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599740.132453:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578079872:12345-0@lo:501:mount.lustre.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.132461:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599740.132657:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578079872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.132704:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599740.132752:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.132773:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.132827:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080000 00000100:00100000:0.0:1787599740.132831:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080000 00000100:00100000:0.0:1787599740.132860:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787599740.132868:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599740.133656:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080000:12345-0@lo:503:mount.lustre.0 Request processed in 786us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.133665:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787599740.133819:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787599740.134410:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599740.134492:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599740.134547:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.134639:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.134763:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080128 00000100:00100000:0.0:1787599740.134769:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080128 00000100:00100000:0.0:1787599740.135336:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599740.135348:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599740.136029:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080128:12345-0@lo:502:mount.lustre.0 Request processed in 683us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.136038:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787599740.136163:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599740.136358:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787599740.136387:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787599740.136404:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787599740.136416:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787599740.136430:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787599740.136443:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787599740.136455:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787599740.136467:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787599740.136480:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787599740.136497:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787599740.136512:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787599740.136526:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787599740.136541:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787599740.136555:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787599740.136569:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787599740.136583:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787599740.136600:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1787599740.136612:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1787599740.136626:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1787599740.136650:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1787599740.136663:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787599740.136676:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787599740.136688:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787599740.136718:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787599740.136747:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787599740.136763:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787599740.136776:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787599740.136788:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787599740.136862:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787599740.136875:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787599740.136888:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787599740.136913:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787599740.136926:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787599740.136939:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787599740.136952:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787599740.136966:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787599740.136978:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787599740.136990:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787599740.137002:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787599740.137026:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787599740.137042:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787599740.137055:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787599740.137068:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787599740.137082:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787599740.137118:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599740.137172:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.137509:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787599740.137585:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080256 00000100:00100000:1.0:1787599740.137592:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080256 00000100:00100000:1.0:1787599740.137627:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787599740.137636:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599740.137752:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578080256:12345-0@lo:502:mount.lustre.0 Request processed in 117us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599740.137759:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599740.137885:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578080256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787599740.137939:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787599740.137948:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787599740.138694:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.138705:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.138708:0:23398:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599740.138712:0:23398:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787599740.138715:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599740.138728:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff96b3707b8000) 00000020:00000080:2.0:1787599740.138757:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787599740.138763:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787599740.138869:0:23398:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787599740.138878:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0da2 00000020:00000080:2.0:1787599740.139246:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787599740.139251:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.139255:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.139256:0:23398:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787599740.139259:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.139263:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.139264:0:23398:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787599740.139268:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599740.139278:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff96b3707bb370) 00000020:00000080:2.0:1787599740.139289:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787599740.139292:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787599740.139294:0:23398:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787599740.139296:0:23398:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787599740.139303:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787599740.139373:0:23398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f896800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787599740.139388:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff96b37f898000) 00000020:00000080:2.0:1787599740.139397:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787599740.139453:0:23398:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787599740.139459:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0db7 00000020:00000080:2.0:1787599740.139545:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787599740.139552:0:23398:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787599740.139557:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5d2988b0929d0dbe 00080000:01000000:2.0:1787599740.139562:0:23398:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787599740.139573:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0dc5 00010000:00010000:3.0:1787599740.191330:0:23398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787599740.192089:0:23398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1787599740.192518:0:23398:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787599740.194113:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787599740.194127:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599740.194134:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599740.194136:0:23398:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787599740.194142:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599740.194148:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599740.194150:0:23398:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787599740.194153:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787599740.194158:0:23398:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:00000080:3.0:1787599740.194186:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599740.194202:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff96b3706f0000) 00000020:00000080:3.0:1787599740.194225:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787599740.194230:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787599740.194318:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787599740.194325:0:23398:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787599740.194332:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0dd3 00010000:00080000:3.0:1787599740.194366:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b351f6f000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599740.199365:0:23398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787599740.204549:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599740.204566:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787599740.204616:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599740.204641:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0dda 00000100:00080000:2.0:1787599740.204651:0:23398:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599740.204657:0:23398:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96b351f6f000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599740.204691:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433adf80 x1874433578080384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599740.204720:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787599740.204787:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.204815:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204817:0:23398:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787599740.204820:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599740.204823:0:23398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787599740.204824:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.204826:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.204827:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599740.204829:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204831:0:23398:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599740.204833:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.204838:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204839:0:23398:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787599740.204843:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787599740.204875:0:23398:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787599740.204888:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.204891:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204892:0:23398:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787599740.204904:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599740.204906:0:23398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787599740.204907:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.204908:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.204916:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599740.204919:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204921:0:23398:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599740.204923:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599740.204927:0:23398:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787599740.204931:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.204932:0:23398:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787599740.204936:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599740.204940:0:23398:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1787599740.204963:0:23398:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787599740.204966:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599740.204978:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff96b37f8999b8) 00000020:00000080:2.0:1787599740.204989:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787599740.204994:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599740.205056:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787599740.205063:0:23398:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787599740.205070:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0de8 00010000:00080000:2.0:1787599740.205101:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b377b8f800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599740.205422:0:23398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1787599740.206016:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578080384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599740.206083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599740.206154:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080384 00000100:00100000:1.0:1787599740.206162:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080384 00000100:00100000:1.0:1787599740.206193:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599740.206200:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578080384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787599740.206223:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:1.0:1787599740.206262:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0def 00000004:00100000:1.0:1787599740.206276:0:22665:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787599740.206281:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:2.0:1787599740.207265:0:23398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787599740.208086:0:23398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787599740.208599:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787599740.208606:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787599740.208609:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599740.208617:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 685 00000100:00080000:3.0:1787599740.208621:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787599740.208627:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599740.208667:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0f100 x1874433578080512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599740.208692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.208696:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599740.208698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.208701:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599740.208767:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578080640:0@lo:400:kworker.0 00000100:00100000:3.0:1787599740.208857:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599740.209219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578080512:0@lo:38:kworker.0 00000100:00100000:1.0:1787599740.209253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787599740.210537:0:23398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787599740.211524:0:22665:0:(import.c:65:import_set_state_nolock()) ffff96b377b89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599740.211611:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578080384:12345-0@lo:38:llog_process_th.0 Request processed in 5407us (5525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.211625:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599740.211647:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080512 00000100:00100000:2.0:1787599740.211652:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080512 00000100:00100000:2.0:1787599740.211674:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599740.211681:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578080512:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787599740.211721:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578080512:12345-0@lo:38:kworker.0 Request processed in 39us (2468us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787599740.211750:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599740.211808:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599740.211816:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599740.211820:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787599740.211824:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578080512:0@lo:38:kworker.0 00000100:00100000:2.0:1787599740.211850:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787599740.211856:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787599740.211863:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787599740.211868:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787599740.211870:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b351f6f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787599740.211882:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578080384:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787599740.211967:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787599740.212134:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1787599740.212610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599740.212625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578080768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599740.212672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.212706:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080768 00000100:00100000:0.0:1787599740.212711:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080768 00000100:00100000:0.0:1787599740.212748:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599740.212756:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433578080768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599740.212781:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787599740.212882:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1874433578080768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.212889:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599740.212938:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578080768:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787599740.213273:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787599740.213279:0:23403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787599740.213367:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578080640 00000100:00100000:3.0:1787599740.213373:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578080640 00000100:00100000:3.0:1787599740.213416:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599740.213425:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578080640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599740.213501:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578080640:12345-0@lo:400:kworker.0 Request processed in 78us (4644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.213507:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787599740.213626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96b377b0d180 x1874433578080640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599740.213646:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578080640:0@lo:400:kworker.0 00000020:00000080:2.0:1787599740.214463:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599740.214476:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599740.214516:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787599740.214539:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0df6 00000100:00080000:2.0:1787599740.214546:0:23398:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599740.214552:0:23398:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b377b8f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599740.214579:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433adf80 x1874433578080896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599740.214636:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578080896:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787599740.214677:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578080896 offset 0 length 520: 4 00000100:00080000:2.0:1787599740.214726:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787599740.214826:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.214830:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.214833:0:23398:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787599740.214836:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787599740.214839:0:23398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787599740.214840:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.214849:0:23398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787599740.214850:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787599740.214853:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.214855:0:23398:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787599740.214857:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787599740.214861:0:23398:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787599740.214865:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.214866:0:23398:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787599740.214869:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787599740.214873:0:23398:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.101@tcp to nid 0x20000c0a8ca65 (192.168.202.101@tcp) 00000020:01000000:2.0:1787599740.214904:0:23398:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787599740.214908:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787599740.214920:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff96b37f89cd28) 00000020:00000080:2.0:1787599740.214932:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787599740.214937:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787599740.215010:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787599740.215018:0:23398:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787599740.215024:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5d2988b0929d0e04 00010000:00080000:2.0:1787599740.215052:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3707a5800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599740.215411:0:23398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787599740.215478:0:23398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787599740.215493:0:23398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787599740.217301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.217308:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599740.217311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.217314:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787599740.217569:0:23398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599740.217821:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787599740.217998:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787599740.218605:0:23405:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787599740.218610:0:23405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787599740.219620:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787599740.219633:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787599740.219675:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787599740.219699:0:23398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0e0b 00000100:00080000:2.0:1787599740.219710:0:23398:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599740.219723:0:23398:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599740.219769:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ad500 x1874433578081024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599740.219847:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578081024:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787599740.219915:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578081024 offset 0 length 520: 4 00000100:00080000:2.0:1787599740.220046:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787599740.220100:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.220245:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.220247:0:23398:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787599740.220251:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.220255:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.220257:0:23398:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787599740.220260:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787599740.220262:0:23398:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787599740.220264:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.220267:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.220268:0:23398:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787599740.220270:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.220272:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.220273:0:23398:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787599740.220277:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787599740.220305:0:23398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.220307:0:23398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.220309:0:23398:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787599740.220312:0:23398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1787599740.220465:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787599740.220502:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787599740.220524:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d94 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.220536:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d400/0x5d2988b0929d0d8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0d94 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599740.220545:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f896800 from 1 10000000:01000000:0.0:1787599740.220548:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599740.220581:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.220589:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.220600:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599740.220616:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599740.220657:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.220685:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b2432e4a80 going to sleep for 11 seconds 00000100:00080000:3.0:1787599740.220786:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.220818:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599740.220821:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.220823:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599740.220932:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081152 00000100:00100000:0.0:1787599740.220938:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081152 00000100:00100000:0.0:1787599740.220987:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599740.220996:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+15:23394:x1874433578081152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599740.221008:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599740.221020:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e12 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.221040:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.221050:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 16 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.221058:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d400, rc 0) 00000100:00100000:0.0:1787599740.221098:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:23394:x1874433578081152:12345-0@lo:101:mount.lustre.0 Request processed in 102us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.221117:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599740.221387:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599740.221401:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.221409:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599740.222035:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787599740.222084:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.222267:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.222411:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081280 00000100:00100000:3.0:1787599740.222417:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081280 00000100:00100000:3.0:1787599740.222496:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787599740.222505:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:23394:x1874433578081280:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787599740.222520:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787599740.222538:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787599740.222542:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787599740.222630:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:23394:x1874433578081280:12345-0@lo:256:mount.lustre.0 Request processed in 127us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.222637:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599740.222695:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081280:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787599740.223313:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599740.223336:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.223346:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599740.223354:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 1 10000000:01000000:2.0:1787599740.223357:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787599740.223383:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.223391:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.223400:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599740.223416:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599740.223449:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.223758:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.223958:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081408 00000100:00100000:0.0:1787599740.223965:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081408 00000100:00100000:0.0:1787599740.223996:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599740.224005:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:23394:x1874433578081408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599740.224015:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599740.224028:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e20 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.224048:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.224058:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.224067:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3da00, rc 0) 00000100:00100000:0.0:1787599740.224261:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081408:12345-0@lo:101:mount.lustre.0 Request processed in 256us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.224267:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599740.224327:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599740.224340:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599740.224363:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599740.225448:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787599740.225705:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599740.226255:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787599740.226281:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787599740.226296:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787599740.226310:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787599740.226323:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787599740.226335:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787599740.226347:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787599740.226358:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787599740.226370:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787599740.226381:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787599740.226391:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787599740.226409:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787599740.226414:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787599740.226484:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.226549:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.226639:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee536c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.226678:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081536 00000100:00100000:0.0:1787599740.226685:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081536 00000100:00100000:0.0:1787599740.226784:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599740.226822:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599740.227051:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081536:12345-0@lo:501:mount.lustre.0 Request processed in 258us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.227059:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599740.227132:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.227162:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599740.227205:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599740.227437:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee536c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.227517:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081664 00000100:00100000:3.0:1787599740.227522:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081664 00000100:00100000:2.0:1787599740.227612:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787599740.227620:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599740.227719:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081664:12345-0@lo:503:mount.lustre.0 Request processed in 99us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.227726:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599740.227841:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599740.228357:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599740.228440:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.228482:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.228506:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3532383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.228525:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081792 00000100:00100000:3.0:1787599740.228530:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081792 00000100:00100000:3.0:1787599740.228552:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599740.228559:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.228636:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081792:12345-0@lo:502:mount.lustre.0 Request processed in 77us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.228643:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599740.228681:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599740.228968:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787599740.228998:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787599740.229012:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787599740.229025:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787599740.229038:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787599740.229050:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787599740.229062:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787599740.229073:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787599740.229084:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787599740.229096:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1787599740.229196:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1787599740.229219:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.229257:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.229285:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578081920 00000100:00100000:3.0:1787599740.229289:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578081920 00000100:00100000:3.0:1787599740.229310:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599740.229316:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.229381:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578081920:12345-0@lo:502:mount.lustre.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.229387:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599740.229416:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3532383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.229428:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578081920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599740.229461:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787599740.229468:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787599740.230225:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.230235:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.230238:0:23407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787599740.230244:0:23407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f896800 00000020:00000080:2.0:1787599740.230247:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599740.230253:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.230256:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.230257:0:23407:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787599740.230260:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.230262:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.230263:0:23407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787599740.230266:0:23407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f896800 00000020:00000080:2.0:1787599740.230268:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599740.230379:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.230383:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.230385:0:23407:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787599740.230387:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.230390:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.230392:0:23407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787599740.230395:0:23407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f896800 00000020:00000080:2.0:1787599740.230397:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599740.232184:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.232196:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.232199:0:23407:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787599740.232203:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787599740.232208:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.232209:0:23407:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787599740.232214:0:23407:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f896800 00000020:00000080:2.0:1787599740.232216:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787599740.232273:0:23407:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787599740.232276:0:23407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787599740.232278:0:23407:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787599740.232281:0:23407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787599740.238552:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787599740.238600:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599740.238624:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.238640:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599740.238714:0:23394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787599740.238717:0:23394:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b37f896800 10000000:01000000:3.0:1787599740.238720:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b37f896800 10000000:01000000:3.0:1787599740.238724:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787599740.238741:0:23394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37f896800 from 1 10000000:01000000:3.0:1787599740.238744:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787599740.238787:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.238816:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.238828:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599740.238855:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787599740.239988:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.240044:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.241058:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082048 00000100:00100000:0.0:1787599740.241069:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082048 00000100:00100000:0.0:1787599740.241197:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787599740.241208:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:23394:x1874433578082048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599740.241230:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599740.241248:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e2e expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.241276:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e2e expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.241288:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3de00/0x5d2988b0929d0e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e2e expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.241297:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3de00, rc 0) 00000100:00100000:0.0:1787599740.241368:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082048:12345-0@lo:101:mount.lustre.0 Request processed in 162us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.241375:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599740.242069:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599740.242089:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e35 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.242099:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e35 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599740.246064:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787599740.247486:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599740.247685:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787599740.249014:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787599740.249074:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787599740.249088:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787599740.249100:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787599740.250179:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787599740.250201:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787599740.250216:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787599740.250230:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787599740.250245:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787599740.250259:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787599740.250273:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787599740.250285:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787599740.250299:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787599740.250313:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787599740.250327:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787599740.250342:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787599740.250376:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787599740.250391:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787599740.250404:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787599740.250417:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787599740.250431:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787599740.250444:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787599740.250456:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787599740.250469:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787599740.250483:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787599740.250498:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787599740.250512:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787599740.250526:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787599740.250541:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787599740.250557:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787599740.250571:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787599740.250585:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787599740.251988:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787599740.252053:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787599740.252066:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787599740.252078:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787599740.252090:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787599740.252936:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787599740.252975:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787599740.252992:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787599740.253006:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787599740.253021:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787599740.253034:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787599740.253047:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787599740.253058:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787599740.253071:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787599740.253084:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787599740.253391:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787599740.253411:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787599740.253430:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787599740.253435:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787599740.253550:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599740.253628:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.253681:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.253816:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082176 00000100:00100000:2.0:1787599740.253824:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082176 00000100:00100000:2.0:1787599740.253878:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787599740.253888:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599740.254021:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082176:12345-0@lo:501:mount.lustre.0 Request processed in 134us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.254029:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599740.256288:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599740.256345:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599740.256427:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.256480:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238240 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.256852:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082304 00000100:00100000:2.0:1787599740.256859:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082304 00000100:00100000:2.0:1787599740.256912:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787599740.256921:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599740.257040:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082304:12345-0@lo:503:mount.lustre.0 Request processed in 119us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.257047:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599740.259276:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599740.259966:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599740.260051:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.262348:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.262389:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238180 going to sleep for 11 seconds 00010000:00010000:3.0:1787599740.262407:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599740.262474:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082432 00000100:00100000:3.0:1787599740.262484:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082432 00000100:00100000:3.0:1787599740.262531:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599740.262541:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.262676:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082432:12345-0@lo:502:mount.lustre.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.262684:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599740.262757:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599740.262995:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787599740.263025:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787599740.263039:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787599740.263052:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787599740.263067:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787599740.263080:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787599740.263095:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787599740.264250:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787599740.264282:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787599740.264297:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787599740.264312:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787599740.264347:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787599740.264363:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787599740.264378:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787599740.264392:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787599740.264407:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787599740.264422:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787599740.264435:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787599740.264462:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787599740.264476:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787599740.264490:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787599740.264503:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787599740.264518:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787599740.264533:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787599740.264547:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787599740.264563:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787599740.264582:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787599740.264608:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787599740.264624:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787599740.264638:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787599740.264651:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787599740.264665:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787599740.264679:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787599740.264691:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787599740.264704:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787599740.264717:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787599740.264741:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787599740.264757:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787599740.264770:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787599740.264783:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787599740.264817:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787599740.264834:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787599740.264848:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787599740.264877:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787599740.267229:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787599740.267299:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787599740.267311:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787599740.267323:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787599740.267383:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.267458:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.267498:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238180 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.268383:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082560 00000100:00100000:3.0:1787599740.268396:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082560 00000100:00100000:3.0:1787599740.268450:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599740.268459:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.268604:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082560:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599740.268612:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599740.268678:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599740.268890:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1787599740.268979:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1787599740.269008:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599740.269047:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.269074:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599740.270307:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082688 00000100:00100000:2.0:1787599740.270317:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082688 00000100:00100000:2.0:1787599740.270362:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599740.270373:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599740.270488:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082688:12345-0@lo:502:mount.lustre.0 Request processed in 116us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599740.270496:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787599740.271031:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599740.271224:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1787599740.271235:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787599740.273399:0:23412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787599740.273419:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96b3706f4d28) 00000020:00000080:3.0:1787599740.273444:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787599740.273546:0:23412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f896800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787599740.273550:0:23412:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f896800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787599740.273553:0:23412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f896800 3 00010000:00080000:3.0:1787599740.273595:0:23412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b3434d7800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.101@tcp at head 00010000:00010000:3.0:1787599740.281165:0:23412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787599740.281379:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787599740.281427:0:23412:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599740.281445:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5d2988b0929d0e43 00000100:00080000:3.0:1787599740.281455:0:23412:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599740.281461:0:23412:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96b3434d7800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599740.281495:0:23412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0fb80 x1874433578082816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599740.281533:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578082816:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599740.281598:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787599740.281654:0:23412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787599740.281674:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.281678:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599740.281681:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599740.281684:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787599740.287088:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1787599740.287214:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787599740.287244:0:23394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599740.287263:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e35 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599740.287276:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d600/0x5d2988b0929d0e2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e35 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599740.287324:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599740.287327:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.287328:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.287329:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.287330:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.287332:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.287333:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.287339:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.287340:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599740.287344:0:23394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787599740.287347:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599740.287348:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.287349:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.287350:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.287351:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.287351:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.287352:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.287353:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.287354:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599740.287379:0:23394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787599740.287399:0:23394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599740.287472:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599740.287503:0:23394:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3532383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599740.287530:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082944 00000100:00100000:3.0:1787599740.287538:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082944 00000100:00100000:3.0:1787599740.288758:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787599740.288773:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787599740.288815:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787599740.288829:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787599740.291604:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578082816 00000100:00100000:0.0:1787599740.291620:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578082816 00000100:00100000:0.0:1787599740.291672:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599740.291682:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1874433578082816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787599740.291709:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:0.0:1787599740.291762:0:22661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5d2988b0929d0e4a 00000004:00100000:0.0:1787599740.291782:0:22661:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599740.291957:0:22661:0:(import.c:65:import_set_state_nolock()) ffff96b37f890000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599740.292997:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1874433578082816:12345-0@lo:38:llog_process_th.0 Request processed in 1312us (11395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.293008:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787599740.293079:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b377b0fb80 x1874433578082816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599740.293092:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599740.293164:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787599740.293173:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787599740.293178:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599740.293181:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3434d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599740.293188:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1874433578082816:0@lo:38:llog_process_th.0 00000001:00100000:3.0:1787599740.293349:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787599740.293489:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787599740.293498:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787599740.294026:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:23394:x1874433578082944:12345-0@lo:253:mount.lustre.0 Request processed in 5256us (6552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599740.294036:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787599740.294053:0:23394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:23394:1874433578082944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599740.294066:0:23394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787599740.294069:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599740.294071:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787599740.294073:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599740.294074:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599740.294076:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599740.294077:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599740.294078:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787599740.294081:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599740.294082:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599740.294093:0:23394:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787599740.297891:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787599740.297903:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787599740.297926:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.297952:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.297960:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.297967:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298007:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298021:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 17 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599740.298036:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578083072:0@lo:104: 00000100:00100000:0.0:1787599740.298097:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599740.298150:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298159:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599740.298168:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578083200:0@lo:104: 00000100:00100000:0.0:1787599740.298188:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.298203:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.298224:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083072 00000100:00100000:0.0:1787599740.298230:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083072 00000100:00100000:0.0:1787599740.298262:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083200 00000100:00100000:0.0:1787599740.298271:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083200 00000100:00100000:0.0:1787599740.298288:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599740.298296:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578083072:12345-0@lo:104: 00010000:00010000:0.0:1787599740.298308:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298348:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599740.298353:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578083072:12345-0@lo:104: Request processed in 58us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.298359:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599740.298373:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599740.298378:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578083200:12345-0@lo:104: 00010000:00010000:0.0:1787599740.298385:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298411:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599740.298416:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578083200:12345-0@lo:104: Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.298421:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599740.298448:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578083072:0@lo:104: 00000100:00100000:0.0:1787599740.298455:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578083200:0@lo:104: 00010000:00010000:0.0:1787599740.298470:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298484:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599740.298490:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298505:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599740.298508:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298516:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599740.298522:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599740.298528:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599740.298553:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298560:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599740.298579:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298586:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e19 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298598:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599740.298601:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298607:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599740.298609:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298624:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599740.298630:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599740.298635:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599740.298648:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298654:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599740.298660:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298666:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d55 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298678:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599740.298680:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599740.298682:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599740.298688:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599740.298705:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578083328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599740.298745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.298765:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599740.298770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578083456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599740.298789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.298836:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083328 00000100:00100000:0.0:1787599740.298840:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083328 00010000:00010000:0.0:1787599740.298861:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 18 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599740.298879:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083456 00000100:00100000:0.0:1787599740.298882:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083456 00010000:00010000:0.0:1787599740.298891:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 19 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599740.298902:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599740.298907:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:3645:x1874433578083328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599740.298916:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599740.298921:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 19 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298930:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 19 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298942:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e12 expref: 19 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.298953:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599740.298977:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3645:x1874433578083328:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.298983:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599740.298994:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599740.299000:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:3645:x1874433578083456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599740.299007:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599740.299011:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299030:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299040:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0d4e expref: 17 pid: 22655 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299051:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299058:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599740.299071:0:22645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013577406s 00010000:00010000:0.0:1787599740.299076:0:22645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299082:0:22645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299087:0:22645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299093:0:22645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299098:0:22645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ca00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599740.299101:0:22645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299108:0:22645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299126:0:22645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299134:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599740.299158:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:3645:x1874433578083456:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.299164:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787599740.299191:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578083456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599740.299198:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578083328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599740.299213:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299219:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599740.299225:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3ca00/0x5d2988b0929d0e51 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1787599740.302808:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787599740.302873:0:23418:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787599740.302877:0:23418:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787599740.303269:0:23419:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787599740.303283:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787599740.304365:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083584:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.304445:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.304485:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083584 00000100:00100000:0.0:1787599740.304492:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083584 00000100:00100000:0.0:1787599740.304535:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599740.304544:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083584:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.304623:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083584:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.304640:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599740.304664:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.304687:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083584:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787599740.304714:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787599740.305002:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305035:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.305055:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083712 00000100:00100000:0.0:1787599740.305058:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083712 00000100:00100000:0.0:1787599740.305077:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599740.305083:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083712:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305166:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083712:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.305172:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599740.305188:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.305202:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083712:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305248:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1874433578083840:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305273:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.305317:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083840 00000100:00100000:0.0:1787599740.305321:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083840 00000100:00100000:0.0:1787599740.305343:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599740.305348:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1874433578083840:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305487:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1874433578083840:12345-0@lo:900:lod0001_rec0000.0 Request processed in 138us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.305494:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787599740.305516:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea0c0 going to sleep for 11 seconds 00010000:00080000:0.0:1787599740.305638:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2436fed80 x1874433578083840/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599740.305650:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1874433578083840:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305687:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305711:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599740.305739:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578083968 00000100:00100000:0.0:1787599740.305743:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578083968 00000100:00100000:0.0:1787599740.305765:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599740.305771:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787599740.305832:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874433578083968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599740.305839:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599740.305855:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599740.305867:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874433578083968:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787599740.305995:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787599740.306648:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787599740.306689:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787599740.307285:0:23394:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787599740.307302:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787599740.307347:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599740.308426:0:23419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787599740.312278:0:23394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787599740.315402:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787599740.315478:0:23419:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787599740.316671:0:23394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:0.0:1787599740.317718:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787599740.317821:0:23420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787599740.317827:0:23420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:3.0:1787599740.318810:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787599740.318971:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787599740.319438:0:23394:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1787599740.324176:0:23394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787599740.337327:0:23394:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787599740.337386:0:23394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1441867988 00100000:10000000:3.0:1787599740.337396:0:23394:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787599740.338618:0:23394:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787599740.338651:0:23394:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787599740.338667:0:23394:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787599740.338689:0:23394:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787599740.347711:0:23394:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599740.347965:0:23394:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787599740.712755:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:2.0:1787599741.295342:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599741.350769:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787599741.744615:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 10000000:01000000:0.0:1787599741.860991:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599741.860999:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f896800 from 12 10000000:01000000:0.0:1787599741.861005:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599741.861056:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.861069:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.861101:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599741.861128:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599741.861227:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599741.861328:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599741.861994:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084096 00000100:00100000:3.0:1787599741.862100:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084096 00000100:00100000:3.0:1787599741.862258:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787599741.862269:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:22657:x1874433578084096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599741.862285:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599741.862304:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e58 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599741.862330:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599741.862341:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599741.862351:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c400, rc 0) 00000100:00100000:3.0:1787599741.862417:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578084096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599741.862425:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787599741.862500:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599741.862515:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.862525:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599741.862583:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787599741.862615:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599741.862695:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599741.862727:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084224 00000100:00100000:2.0:1787599741.862733:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084224 00000100:00100000:2.0:1787599741.862756:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787599741.862763:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578084224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787599741.862776:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599741.862830:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599741.862833:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787599741.862921:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578084224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599741.862929:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599741.863024:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787599741.863066:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599741.863073:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.863081:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599741.863090:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787599741.863093:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b344b34800 from 12 10000000:01000000:0.0:1787599741.863100:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787599741.863118:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.863125:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.863134:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599741.863146:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599741.863184:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599741.863209:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599741.863366:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084352 00000100:00100000:2.0:1787599741.863369:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084352 00000100:00100000:2.0:1787599741.863384:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787599741.863388:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578084352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599741.863393:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599741.863403:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e66 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599741.863423:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599741.863432:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599741.863449:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6600, rc 0) 00000100:00100000:2.0:1787599741.863484:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578084352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599741.863488:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599741.863539:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599741.863546:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.863551:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599741.863578:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787599741.863598:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599741.863614:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea900 going to sleep for 11 seconds 00000100:00100000:1.0:1787599741.863876:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084480 00000100:00100000:1.0:1787599741.863890:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084480 00000100:00100000:1.0:1787599741.863925:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599741.863934:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578084480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599741.863947:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599741.863962:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599741.863965:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787599741.864052:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578084480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599741.864060:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787599741.864779:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578084480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787599741.864872:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787599741.864881:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599741.864902:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599742.317976:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599742.377871:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599742.762018:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:2.0:1787599743.336723:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599743.784322:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:2.0:1787599744.365955:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599744.814777:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 0 seconds 00010000:00010000:1.0:1787599745.381175:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599745.573629:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599745.573654:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578084608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599745.573747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599745.573819:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084608 00000100:00100000:1.0:1787599745.573828:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084608 00000100:00100000:1.0:1787599745.573890:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599745.573902:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578084608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599745.573937:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787599745.573983:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578084608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599745.573990:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787599745.574050:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578084608:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787599745.574849:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787599745.574854:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787599745.574858:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599745.574867:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96b3707b4800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599745.574898:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b351768a80 x1874433578084864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599745.574914:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599745.574917:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599745.574920:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599745.574925:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599745.574943:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599745.574960:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599745.574963:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599745.574965:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599745.574993:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578084864:0@lo:38:kworker.0 00000100:00100000:3.0:1787599745.575350:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599745.575362:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578084736:0@lo:400:kworker.0 00000100:00100000:3.0:1787599745.575413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599745.575460:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084736 00000100:00100000:3.0:1787599745.575465:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084736 00000100:00100000:3.0:1787599745.575656:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599745.575666:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3647:x1874433578084736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599745.575721:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3647:x1874433578084736:12345-0@lo:400:kworker.0 Request processed in 58us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599745.575727:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787599745.575782:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578084736:0@lo:400:kworker.0 00000100:00100000:1.0:1787599745.575910:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599745.575954:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578084992:0@lo:400:kworker.0 00000100:00100000:1.0:1787599745.575982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599745.576707:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084864 00000100:00100000:3.0:1787599745.576716:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084864 00000100:00100000:1.0:1787599745.576811:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599745.576820:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578085120:0@lo:400:kworker.0 00000100:00100000:1.0:1787599745.576861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599745.576914:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578084992 00000100:00100000:1.0:1787599745.576918:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578084992 00000100:00100000:1.0:1787599745.576954:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085120 00000100:00100000:1.0:1787599745.576957:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085120 00000100:00100000:1.0:1787599745.576973:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599745.576981:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578084992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599745.577041:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578084992:12345-0@lo:400:kworker.0 Request processed in 61us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599745.577049:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599745.577064:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599745.577070:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578085120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599745.577096:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578085120:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599745.577102:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787599745.577137:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b351768e00 x1874433578085120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599745.577160:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578085120:0@lo:400:kworker.0 00010000:00080000:1.0:1787599745.577171:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b351769c00 x1874433578084992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599745.577179:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578084992:0@lo:400:kworker.0 00000100:00100000:3.0:1787599745.580892:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787599745.580906:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1874433578084864:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787599745.580949:0:22665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:3.0:1787599745.580993:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0e74 00000004:00100000:3.0:1787599745.581024:0:22665:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787599745.581029:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1787599745.593632:0:22665:0:(import.c:65:import_set_state_nolock()) ffff96b3812c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599745.593762:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578084864:12345-0@lo:38:kworker.0 Request processed in 12854us (17850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599745.593774:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787599745.594300:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787599745.594311:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787599745.594318:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787599745.594321:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787599745.594334:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000621fefeb): req@ffff96b377b0dc00 x1874433578077440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599745.594366:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578084864:0@lo:38:kworker.0 00000100:00100000:3.0:1787599745.594492:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599745.594522:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599745.595117:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599745.595132:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578085248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599745.595168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599745.595202:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578077440 00000100:00100000:0.0:1787599745.595208:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578077440 00000100:00100000:0.0:1787599745.595239:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085248 00000100:00100000:0.0:1787599745.595242:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085248 00000100:00100000:0.0:1787599745.595257:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599745.595265:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22702:x1874433578077440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787599745.595349:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22702:x1874433578077440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599745.595357:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599745.595375:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787599745.595381:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578085248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787599745.595406:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599745.595450:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874433578077440:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787599745.595500:0:22702:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787599745.595541:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874433578085376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787599745.596879:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578085248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1491us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599745.597186:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578085248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599745.597658:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599745.603607:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599745.603665:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3781efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599745.604841:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085376 00000100:00100000:0.0:1787599745.604864:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085376 00000100:00100000:0.0:1787599745.604931:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787599745.604941:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22702:x1874433578085376:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787599745.605126:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22702:x1874433578085376:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 186us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599745.605134:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599745.606223:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874433578085376:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599745.606342:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874433578085504:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599745.606398:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599745.606440:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b381286b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599745.606466:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085504 00000100:00100000:1.0:1787599745.606472:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085504 00000100:00100000:1.0:1787599745.606519:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599745.606528:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874433578085504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787599745.606602:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874433578085504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599745.606609:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599745.606637:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22702:1874433578085504:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787599745.606681:0:22702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599745.609461:0:22702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787599745.609562:0:22702:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1787599745.609568:0:22702:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1787599745.842243:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599746.416211:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787599746.660954:0:23663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787599747.428999:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787599747.736312:0:23715:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599747.736501:0:23715:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599748.454160:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599748.645950:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599733/real 1787599733] req@ffff96b2433ad180 x1874433578078464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599748.645982:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433ad180 x1874433578078464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599748.645993:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599733/real 1787599733] req@ffff96b2433ac700 x1874433578078592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599748.646004:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433ac700 x1874433578078592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599748.646021:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599748.646043:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599748.646047:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078464:0@lo:8:kworker.0 00000100:00080000:1.0:1787599748.646051:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599748.646074:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599748.646077:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578078592:0@lo:8:kworker.0 00000100:00100000:2.0:1787599748.646260:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578085760:0@lo:400:kworker.0 00000100:00100000:2.0:1787599748.646325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599748.646392:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599748.646400:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578085632:0@lo:400:kworker.0 00000100:00100000:1.0:1787599748.646428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599748.646463:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085760 00000100:00100000:1.0:1787599748.646470:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085760 00000100:00100000:1.0:1787599748.646513:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599748.646520:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578085760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787599748.646578:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599748.646582:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787599748.646585:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599748.646590:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:3.0:1787599748.646594:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599748.646599:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b3707b3000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599748.646620:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0ce00 x1874433578085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599748.646652:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599748.646654:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599748.646665:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599748.646668:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 680 00000100:00080000:3.0:1787599748.646671:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787599748.646674:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599748.646686:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0df80 x1874433578086016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599748.646768:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578085760:12345-0@lo:400:kworker.0 Request processed in 247us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599748.646775:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787599748.646852:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578085632 00000100:00100000:0.0:1787599748.646856:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578085632 00000100:00100000:0.0:1787599748.646884:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599748.646890:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3647:x1874433578085632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599748.646924:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3647:x1874433578085632:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599748.646930:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787599748.651008:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578085632:0@lo:400:kworker.0 00000100:00080000:3.0:1787599748.651341:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599748.651347:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599748.651350:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599748.651353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787599748.651388:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599748.651459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599748.651516:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086144 00000100:00100000:3.0:1787599748.651523:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086144 00000100:00100000:3.0:1787599748.651573:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599748.651581:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578086144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599748.651646:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578086144:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599748.651653:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787599748.651698:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b377b0c380 x1874433578086144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599748.651733:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787599748.651755:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578085888:0@lo:8:kworker.0 00000400:00000100:3.0:1787599748.651785:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578085888 offset 0 length 520: 4 00000100:00100000:0.0:1787599748.651925:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578086272:0@lo:400:kworker.0 00000100:00100000:3.0:1787599748.652194:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578086016:0@lo:8:kworker.0 00000100:00100000:1.0:1787599748.652269:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578086400:0@lo:400:kworker.0 00000100:00100000:2.0:1787599748.652358:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578085760:0@lo:400:kworker.0 00000100:00100000:0.0:1787599748.652432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599748.652508:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086272 00000100:00100000:2.0:1787599748.652514:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086272 00000100:00100000:2.0:1787599748.652556:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599748.652566:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578086272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599748.652615:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578086272:12345-0@lo:400:kworker.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599748.652622:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787599748.652669:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578086272:0@lo:400:kworker.0 00000400:00000100:3.0:1787599748.652980:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578086016 offset 0 length 520: 4 00000100:00100000:1.0:1787599748.653055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599748.653147:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086400 00000100:00100000:0.0:1787599748.653152:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086400 00000100:00100000:0.0:1787599748.653220:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599748.653229:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578086400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599748.653312:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578086400:12345-0@lo:400:kworker.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599748.653319:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787599748.653387:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b377b0f800 x1874433578086400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599748.653399:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578086400:0@lo:400:kworker.0 00000020:00000004:2.0:1787599748.878759:0:23765:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787599748.879026:0:23765:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787599749.482965:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599749.928760:0:23813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9fd67ac0 20000000:00000080:3.0:1787599749.928786:0:23813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b3814a9000 uarg=0000000000000000 20000000:01000000:0.0:1787599749.937481:0:23813:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787599749.937498:0:23813:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787599749.937504:0:23813:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787599749.938635:0:23814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787599749.938834:0:23813:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787599749.949449:0:23813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787599749.949740:0:23813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.949764:0:23813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.949771:0:23813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.949778:0:23813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.949854:0:23813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.949870:0:23813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599749.949885:0:23813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23813:1874433578086528:0@lo:104: 00000100:00100000:3.0:1787599749.949955:0:23813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599749.950239:0:23813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.950248:0:23813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 17 pid: 22653 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599749.950257:0:23813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23813:1874433578086656:0@lo:104: 00000100:00100000:3.0:1787599749.950282:0:23813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599749.950304:0:23813:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3782f1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599749.950562:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086528 00000100:00100000:0.0:1787599749.950571:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086528 00000100:00100000:0.0:1787599749.950622:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086656 00000100:00100000:0.0:1787599749.950625:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086656 00000100:00100000:0.0:1787599749.950638:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599749.950657:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:23813:x1874433578086528:12345-0@lo:104: 00010000:00010000:0.0:1787599749.950671:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599749.950734:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599749.950740:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:23813:x1874433578086528:12345-0@lo:104: Request processed in 94us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599749.950747:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787599749.950763:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787599749.950768:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:23813:x1874433578086656:12345-0@lo:104: 00010000:00010000:0.0:1787599749.950775:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599749.950831:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599749.950836:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:23813:x1874433578086656:12345-0@lo:104: Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599749.950842:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787599749.951179:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599749.951194:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951202:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599749.951206:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951216:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599749.951223:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599749.951228:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599749.951270:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951275:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599749.951297:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951304:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b7400/0x5d2988b0929d0e20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e27 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951318:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599749.951321:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951325:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599749.951328:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951344:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599749.951350:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599749.951354:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599749.951367:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951371:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599749.951377:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951383:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d800/0x5d2988b0929d0d1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0d24 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951396:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599749.951398:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599749.951399:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599749.951406:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599749.951419:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578086784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599749.951458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599749.951497:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599749.951502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578086912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599749.951522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599749.951568:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086784 00000100:00100000:2.0:1787599749.951573:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086784 00010000:00010000:2.0:1787599749.951599:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 18 pid: 22655 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599749.951618:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578086912 00000100:00100000:2.0:1787599749.951621:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578086912 00010000:00010000:2.0:1787599749.951632:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 19 pid: 22653 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599749.951642:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599749.951663:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:3645:x1874433578086784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599749.951673:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599749.951679:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 19 pid: 22655 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951689:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 19 pid: 22655 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951703:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599749.951731:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:3645:x1874433578086784:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599749.951737:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787599749.951750:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599749.951755:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3645:x1874433578086912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599749.951762:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599749.951766:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 18 pid: 22653 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951774:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 18 pid: 22653 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951836:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951845:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951859:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951866:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951872:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951877:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951881:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200cc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599749.951885:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951890:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951897:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599749.951905:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599749.951929:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3645:x1874433578086912:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599749.951942:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787599749.952437:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578086912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599749.952446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578086784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599749.954025:0:23813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3da00/0x5d2988b0929d0e27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e20 expref: 17 pid: 22655 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599749.954058:0:23813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23813:1874433578086528:0@lo:104: 00010000:00010000:3.0:1787599749.954074:0:23813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54b200/0x5d2988b0929d0d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0d1d expref: 16 pid: 22653 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599749.954082:0:23813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23813:1874433578086656:0@lo:104: 00010000:00010000:3.0:1787599749.954111:0:23813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.954123:0:23813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.954130:0:23813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599749.954137:0:23813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599750.503909:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599750.693180:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578087040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599750.693260:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599750.693474:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087040 00000100:00100000:1.0:1787599750.693484:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087040 00000100:00100000:1.0:1787599750.693547:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599750.693557:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578087040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599750.693593:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787599750.693663:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578087040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599750.693670:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599750.693899:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b35176ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578087040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599750.693978:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599740/real 1787599740] req@ffff96b2433ad500 x1874433578081024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599750 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599750.693994:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433ad500 x1874433578081024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599750 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599750.694003:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599740/real 1787599740] req@ffff96b2433adf80 x1874433578080896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599750 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599750.694013:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b2433adf80 x1874433578080896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599750 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599750.694027:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599750.694048:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599750.694052:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578081024:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787599750.694056:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b377b8f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599750.694061:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599750.694063:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578080896:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787599750.695854:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599750.695860:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599750.695863:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599750.695866:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787599750.695876:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599750.695879:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787599750.695882:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b377b8f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599750.695889:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1787599750.695895:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599750.695902:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b377b8f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599750.695923:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0dc00 x1874433578087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599750.695938:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599750.695942:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599750.695943:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599750.695946:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1787599750.695948:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787599750.695952:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599750.695962:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0d180 x1874433578087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599750.695999:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578087296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599750.696063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599750.696281:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599750.696305:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578087424:0@lo:400:kworker.0 00000100:00100000:3.0:1787599750.696336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599750.696374:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087424 00000100:00100000:3.0:1787599750.696381:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087424 00000100:00100000:3.0:1787599750.696424:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599750.696434:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578087424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599750.696484:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578087424:12345-0@lo:400:kworker.0 Request processed in 51us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599750.696492:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599750.696520:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578087552:0@lo:8:kworker.0 00000400:00000100:3.0:1787599750.696546:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578087552 offset 0 length 520: 4 00000100:00100000:3.0:1787599750.696571:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578087680:0@lo:8:kworker.0 00000400:00000100:3.0:1787599750.696591:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874433578087680 offset 0 length 520: 4 00000100:00100000:0.0:1787599750.696936:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787599750.696974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599750.697002:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599750.697008:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599750.697028:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599750.697054:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087168 00000100:00100000:0.0:1787599750.697058:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087168 00000100:00100000:0.0:1787599750.697099:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787599750.697117:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:3648:x1874433578087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599750.697155:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:3648:x1874433578087168:12345-0@lo:400:kworker.0 Request processed in 41us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599750.697162:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787599750.697191:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087808 00000100:00100000:0.0:1787599750.697195:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087808 00000100:00100000:0.0:1787599750.697217:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599750.697223:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578087808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599750.697253:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578087808:12345-0@lo:400:kworker.0 Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599750.697258:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787599750.697294:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b377b0f100 x1874433578087808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599750.697307:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578087808:0@lo:400:kworker.0 00000100:00100000:0.0:1787599750.697317:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578087168:0@lo:400:kworker.0 00000100:00100000:1.0:1787599750.698002:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087296 00000100:00100000:1.0:1787599750.698008:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087296 00000100:00100000:1.0:1787599750.698047:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599750.698056:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578087296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599750.698116:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578087296:12345-0@lo:400:kworker.0 Request processed in 61us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599750.698122:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787599750.698284:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b377b0fb80 x1874433578087424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599750.698296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578087424:0@lo:400:kworker.0 00000100:00100000:3.0:1787599750.698307:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578087296:0@lo:400:kworker.0 00000100:00100000:2.0:1787599750.698843:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599750.698857:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578087936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599750.698917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599750.701163:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578087936 00000100:00100000:1.0:1787599750.701179:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578087936 00000100:00100000:1.0:1787599750.701252:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599750.701264:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433578087936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599750.701305:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599750.701388:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874433578087936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599750.701395:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787599750.702614:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578087936:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787599751.210497:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787599751.525237:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787599751.722599:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787599751.722607:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 13 10000000:01000000:0.0:1787599751.722613:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599751.722671:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599751.722685:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599751.722697:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599751.722723:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787599751.723233:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599751.723314:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.726627:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088064 00000100:00100000:3.0:1787599751.726652:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088064 00000100:00100000:3.0:1787599751.726713:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787599751.726724:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+16:22657:x1874433578088064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599751.726742:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599751.726768:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e82 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.726811:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.726823:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.726833:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200cc00, rc 0) 00000100:00100000:3.0:1787599751.726919:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.726926:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787599751.726995:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599751.727014:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.727025:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599751.727102:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.727135:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599751.727161:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088192 00000100:00100000:3.0:1787599751.727164:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088192 00000100:00100000:3.0:1787599751.727189:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787599751.727195:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.727294:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.727309:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787599751.727341:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.727352:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.727378:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.727411:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599751.727430:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088320 00000100:00100000:3.0:1787599751.727433:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088320 00000100:00100000:3.0:1787599751.727452:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599751.727459:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.728680:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1215us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.728689:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787599751.728740:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.728756:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787599751.729393:0:23886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599751.729453:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599751.729472:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599751.729483:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729509:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599751.729520:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599751.729523:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b344b34800 from 13 10000000:01000000:3.0:1787599751.729526:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599751.729562:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729569:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729579:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599751.729596:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.729642:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599751.729661:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.729677:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088448 00000100:00100000:3.0:1787599751.729683:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088448 00000100:00100000:3.0:1787599751.729712:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599751.729719:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+17:22657:x1874433578088448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599751.729730:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599751.729742:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0e90 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729762:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729772:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729781:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200ce00, rc 0) 00000100:00100000:3.0:1787599751.729833:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578088448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.729838:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787599751.729877:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599751.729888:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.729897:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599751.729940:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.729963:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599751.729976:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.729989:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088576 00000100:00100000:3.0:1787599751.729991:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088576 00000100:00100000:3.0:1787599751.730012:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599751.730018:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578088576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.730101:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578088576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.730108:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599751.730135:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.730156:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.730191:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599751.730202:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787599751.730213:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088704 00000100:00100000:3.0:1787599751.730215:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088704 00000100:00100000:3.0:1787599751.730233:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599751.730239:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578088704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599751.730309:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:22657:x1874433578088704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599751.730322:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787599751.730362:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578088704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599751.749151:0:23887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599751.749538:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599751.749564:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599751.749575:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599751.749588:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599752.551233:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599752.615092:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787599753.573020:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599754.601585:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787599755.046494:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599755.629106:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599755.815912:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578088832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599755.815994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599755.816047:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599755.816053:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578088960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599755.816074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599755.816111:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088832 00000100:00100000:3.0:1787599755.816119:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088832 00000100:00100000:3.0:1787599755.816156:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578088960 00000100:00100000:3.0:1787599755.816159:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578088960 00000100:00100000:3.0:1787599755.816176:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599755.816184:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578088832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599755.816223:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599755.816271:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578088832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599755.816286:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787599755.816304:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599755.816310:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578088960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599755.816341:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787599755.816371:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578088960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599755.816376:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787599755.816415:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578088960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599755.816428:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578088832:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787599755.816620:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599755.816626:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599755.816628:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599755.816632:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599755.816643:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599755.816646:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599755.816648:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599755.816652:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599755.816680:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578089216:0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.816715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599755.816737:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599755.816743:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578089088:0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.816787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599755.816846:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089216 00000100:00100000:0.0:1787599755.816851:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089216 00000100:00100000:0.0:1787599755.816885:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599755.816892:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578089216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.816928:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578089216:12345-0@lo:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599755.816935:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599755.816953:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089088 00000100:00100000:0.0:1787599755.816962:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089088 00000100:00100000:0.0:1787599755.816989:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599755.816995:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3648:x1874433578089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.817023:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:3648:x1874433578089088:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599755.817029:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787599755.817062:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578089088:0@lo:400:kworker.0 00010000:00080000:0.0:1787599755.817076:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b243754700 x1874433578089216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599755.817087:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578089216:0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.817120:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599755.817127:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578089344:0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.817153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599755.817177:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089344 00000100:00100000:0.0:1787599755.817181:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089344 00000100:00100000:0.0:1787599755.817203:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599755.817209:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578089344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599755.817239:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578089344:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599755.817245:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787599755.817268:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b243754000 x1874433578089344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599755.817279:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578089344:0@lo:400:kworker.0 00010000:00010000:2.0:1787599756.646028:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599757.670929:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787599758.023877:0:24161:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787599758.023883:0:24161:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787599758.023884:0:24161:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787599758.024174:0:24161:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b37f892000 00000020:01000004:1.0:1787599758.024192:0:24161:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787599758.024206:0:24161:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787599758.024220:0:24161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96b34dcfb370) 00000020:00000080:1.0:1787599758.024238:0:24161:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787599758.125540:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787599758.130285:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787599758.130593:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787599758.131255:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787599758.131516:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787599758.131886:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787599758.132549:0:24161:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787599758.135334:0:24161:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787599758.135590:0:24161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787599758.135604:0:24161:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787599758.135619:0:24161:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929d0ea5 00000020:01000004:2.0:1787599758.135626:0:24161:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787599758.135649:0:24161:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787599758.135653:0:24161:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787599758.135658:0:24161:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787599758.135664:0:24161:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787599758.135675:0:24161:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96b37f89b370) 00000020:00000080:2.0:1787599758.135687:0:24161:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787599758.139476:0:24161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599758.139671:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599758.139679:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787599758.152836:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787599758.152854:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787599758.153728:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787599758.153745:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787599758.158094:0:24161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787599758.158266:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787599758.158271:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787599758.162604:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787599758.162618:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787599758.185283:0:24161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599758.185625:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787599758.185632:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787599758.187686:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787599758.187701:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787599758.198293:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787599758.198308:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787599758.203788:0:24161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599758.204896:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787599758.204903:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787599758.206532:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787599758.206543:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787599758.321605:0:24161:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787599758.322289:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787599758.322298:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787599758.323559:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787599758.323581:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787599758.324398:0:24161:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787599758.324430:0:24161:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787599758.324437:0:24161:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787599758.361208:0:24161:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787599758.361256:0:24161:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.101@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787599758.361260:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787599758.361262:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599758.361264:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599758.361265:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599758.361266:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599758.361268:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599758.361269:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599758.361271:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599758.361272:0:24161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599758.361276:0:24161:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787599758.361278:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787599758.361279:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599758.361280:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599758.361281:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599758.361283:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599758.361284:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599758.361285:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599758.361286:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599758.361287:0:24161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787599758.361314:0:24161:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787599758.361334:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787599758.361411:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.361457:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.361511:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089472 00000100:00100000:3.0:1787599758.361519:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089472 00000100:00100000:3.0:1787599758.361588:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787599758.361599:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:24161:x1874433578089472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787599758.361628:0:22654:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787599758.361631:0:22654:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787599758.361635:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787599758.362002:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:24161:x1874433578089472:12345-0@lo:253:mount.lustre.0 Request processed in 404us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.362011:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787599758.362156:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787599758.362166:0:24161:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787599758.362168:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787599758.362169:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787599758.362171:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787599758.362172:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787599758.362173:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787599758.362174:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787599758.362175:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787599758.362177:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787599758.362178:0:24161:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787599758.362194:0:24161:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b37f892000 from lustre-OST0000 10000000:01000000:2.0:1787599758.362220:0:24161:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787599758.362223:0:24161:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787599758.362231:0:24161:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b345e08000 local copy 00010000:00010000:2.0:1787599758.362241:0:24161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599758.362347:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599758.362380:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.362414:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089900 going to sleep for 11 seconds 00000100:00100000:0.0:1787599758.362466:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089600 00000100:00100000:0.0:1787599758.362471:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089600 00000100:00100000:0.0:1787599758.362507:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787599758.362515:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:24161:x1874433578089600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599758.362592:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:24161:x1874433578089600:12345-0@lo:501:mount.lustre.0 Request processed in 78us (210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599758.362598:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599758.362698:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089600:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787599758.362711:0:24161:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787599758.362728:0:24161:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787599758.362735:0:24161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.362757:0:24161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599758.362821:0:24161:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b37f892000 10000000:01000000:2.0:1787599758.362826:0:24161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787599758.362832:0:24161:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787599758.362835:0:24161:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787599758.362840:0:24161:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787599758.362843:0:24161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787599758.362865:0:24161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.362874:0:24161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.362883:0:24161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599758.362896:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787599758.362923:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599758.363101:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089728 00000100:00100000:3.0:1787599758.363106:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089728 00000100:00100000:3.0:1787599758.363139:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787599758.363146:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+18:24161:x1874433578089728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599758.363154:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599758.363174:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200c000/0x5d2988b0929d0eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0eb3 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.363194:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200c000/0x5d2988b0929d0eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0eb3 expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.363205:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200c000/0x5d2988b0929d0eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0eb3 expref: 19 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.363215:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200c000, rc 0) 00000100:00100000:3.0:1787599758.363244:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578089728:12345-0@lo:101:mount.lustre.0 Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.363251:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599758.363338:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.363352:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599758.363363:0:24161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0eba expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.363372:0:24161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0eba expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787599758.365938:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787599758.367072:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599758.370242:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787599758.370306:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787599758.370324:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787599758.370339:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787599758.370351:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787599758.370363:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787599758.370375:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787599758.370389:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787599758.370401:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787599758.370412:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787599758.370423:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787599758.370434:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787599758.370460:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787599758.370467:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787599758.370594:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599758.370663:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599758.370774:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599758.371212:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089856 00000100:00100000:0.0:1787599758.371221:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089856 00000100:00100000:0.0:1787599758.371312:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787599758.371322:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578089856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599758.371493:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578089856:12345-0@lo:501:mount.lustre.0 Request processed in 171us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.371501:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599758.371587:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599758.371637:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599758.371681:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.371898:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.372170:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578089984 00000100:00100000:3.0:1787599758.372183:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578089984 00000100:00100000:3.0:1787599758.372212:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787599758.372219:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578089984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599758.372937:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578089984:12345-0@lo:503:mount.lustre.0 Request processed in 716us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.373114:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599758.373243:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578089984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787599758.373696:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787599758.373832:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599758.373888:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.374139:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.374283:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090112 00000100:00100000:3.0:1787599758.374290:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090112 00000100:00100000:3.0:1787599758.374322:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787599758.374331:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578090112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599758.375726:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578090112:12345-0@lo:502:mount.lustre.0 Request processed in 1389us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.375749:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787599758.375965:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599758.376223:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787599758.376251:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787599758.376263:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787599758.376275:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787599758.376287:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787599758.376298:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787599758.376311:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787599758.376323:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787599758.376348:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1787599758.376365:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1787599758.376377:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1787599758.376391:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1787599758.376427:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599758.376477:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.376519:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.376907:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090240 00000100:00100000:3.0:1787599758.376915:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090240 00000100:00100000:3.0:1787599758.376975:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787599758.376985:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578090240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599758.377082:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578090240:12345-0@lo:502:mount.lustre.0 Request processed in 99us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.377090:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787599758.377267:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787599758.377329:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1787599758.377339:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787599758.379264:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787599758.379277:0:24178:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787599758.379283:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.379285:0:24178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787599758.379291:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787599758.379308:0:24178:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96b370778000) 00000020:00000080:3.0:1787599758.379331:0:24178:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787599758.379336:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787599758.379419:0:24178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f892000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787599758.379426:0:24178:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787599758.379432:0:24178:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d2988b0929d0ec8 00010000:00010000:3.0:1787599758.392493:0:24178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787599758.393390:0:24178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1787599758.396531:0:24178:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787599758.403170:0:24178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787599758.403187:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599758.403195:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403197:0:24178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787599758.403201:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787599758.403203:0:24178:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787599758.403205:0:24178:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787599758.403207:0:24178:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787599758.403208:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787599758.403211:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403213:0:24178:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787599758.403215:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599758.403218:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403220:0:24178:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787599758.403223:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787599758.403225:0:24178:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787599758.403227:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599758.403229:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403230:0:24178:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787599758.403232:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599758.403235:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403236:0:24178:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787599758.403240:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787599758.403276:0:24178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599758.403279:0:24178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599758.403280:0:24178:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787599758.403283:0:24178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787599758.403584:0:24161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787599758.403619:0:24161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787599758.403646:0:24161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0eba expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599758.403659:0:24161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6200/0x5d2988b0929d0eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0eba expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599758.403668:0:24161:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f892000 from 1 10000000:01000000:0.0:1787599758.403671:0:24161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787599758.403712:0:24161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599758.403721:0:24161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599758.403733:0:24161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599758.403760:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599758.403874:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.404097:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090368 00000100:00100000:2.0:1787599758.404106:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090368 00000100:00100000:2.0:1787599758.404152:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787599758.404162:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:24161:x1874433578090368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599758.404174:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599758.404189:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0ecf expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.404214:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.404224:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.404233:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7400, rc 0) 00000100:00100000:0.0:1787599758.405069:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483ce300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.412654:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090368:12345-0@lo:101:mount.lustre.0 Request processed in 8482us (8769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.412667:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787599758.414759:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599758.414821:0:24161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.414835:0:24161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599758.416447:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787599758.416746:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787599758.417179:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787599758.417207:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787599758.417223:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787599758.417238:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787599758.417255:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787599758.417271:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787599758.417286:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787599758.417299:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787599758.417326:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787599758.417340:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787599758.417352:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787599758.417369:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787599758.417374:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787599758.417458:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599758.417531:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.417647:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.418614:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090496 00000100:00100000:2.0:1787599758.418635:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090496 00000100:00100000:2.0:1787599758.418690:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787599758.418699:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599758.418876:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090496:12345-0@lo:501:mount.lustre.0 Request processed in 177us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.418885:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787599758.419224:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599758.419300:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599758.419345:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.419374:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.419429:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090624 00000100:00100000:2.0:1787599758.419435:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090624 00000100:00100000:2.0:1787599758.419468:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787599758.419476:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787599758.419623:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090624:12345-0@lo:503:mount.lustre.0 Request processed in 147us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.419630:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787599758.420438:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787599758.421243:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599758.421360:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599758.421421:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.421514:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.421555:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090752 00000100:00100000:2.0:1787599758.421561:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090752 00000100:00100000:2.0:1787599758.421648:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787599758.421658:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599758.421853:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090752:12345-0@lo:502:mount.lustre.0 Request processed in 196us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.421861:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787599758.422194:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599758.422411:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787599758.422440:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787599758.422455:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787599758.422467:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787599758.422478:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787599758.422488:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787599758.422500:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787599758.422511:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787599758.422523:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787599758.422536:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787599758.422548:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787599758.422584:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599758.422624:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.422659:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16900 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.422715:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578090880 00000100:00100000:3.0:1787599758.422720:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578090880 00000100:00100000:3.0:1787599758.423115:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787599758.423127:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599758.423240:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578090880:12345-0@lo:502:mount.lustre.0 Request processed in 116us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.423249:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787599758.423334:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578090880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599758.423383:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787599758.423393:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787599758.424560:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599758.424582:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.424584:0:24182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787599758.424591:0:24182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f892000 00000020:00000080:1.0:1787599758.424602:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599758.424611:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599758.424614:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.424616:0:24182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787599758.424618:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599758.424621:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.424622:0:24182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787599758.424625:0:24182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b37f892000 00000020:00000080:1.0:1787599758.424627:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599758.424722:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599758.424726:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.424727:0:24182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787599758.424730:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599758.424733:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.424741:0:24182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599758.424746:0:24182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f892000 00000020:00000080:1.0:1787599758.424748:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599758.431831:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599758.431852:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.431855:0:24182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787599758.431859:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787599758.431864:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.431865:0:24182:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787599758.431870:0:24182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b37f892000 00000020:00000080:1.0:1787599758.431872:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787599758.431959:0:24182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787599758.431963:0:24182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599758.431965:0:24182:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787599758.431968:0:24182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787599758.432932:0:24161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787599758.433049:0:24161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787599758.433068:0:24161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.433092:0:24161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599758.433147:0:24161:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787599758.433150:0:24161:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b37f892000 10000000:01000000:1.0:1787599758.433153:0:24161:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b37f892000 10000000:01000000:1.0:1787599758.433157:0:24161:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599758.433162:0:24161:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b37f892000 from 1 10000000:01000000:1.0:1787599758.433165:0:24161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787599758.433202:0:24161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.433210:0:24161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.433223:0:24161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599758.433246:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599758.433313:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.433354:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599758.435197:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091008 00000100:00100000:3.0:1787599758.435211:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091008 00000100:00100000:3.0:1787599758.435276:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787599758.435289:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578091008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787599758.435305:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599758.435323:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0edd expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.435350:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0edd expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.435362:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b24200de00/0x5d2988b0929d0ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0edd expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.435371:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b24200de00, rc 0) 00000100:00100000:3.0:1787599758.435449:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091008:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599758.435457:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787599758.439713:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599758.439763:0:24161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ee4 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.439777:0:24161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0ee4 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599758.441375:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787599758.441662:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599758.446106:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787599758.446166:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787599758.446181:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787599758.446194:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787599758.446206:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787599758.446219:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787599758.446231:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787599758.446264:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787599758.446280:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787599758.446291:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787599758.446303:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787599758.446315:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787599758.446327:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787599758.446339:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787599758.446353:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787599758.446366:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787599758.446378:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787599758.446389:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787599758.446400:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787599758.446413:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787599758.446424:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787599758.446436:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787599758.446449:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787599758.446476:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787599758.446492:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787599758.446506:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787599758.446519:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787599758.446530:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787599758.446540:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787599758.446561:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787599758.449197:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787599758.449256:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787599758.449273:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787599758.449287:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787599758.449299:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787599758.449312:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787599758.449325:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787599758.449337:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787599758.449350:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787599758.449388:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787599758.449404:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787599758.449417:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787599758.449429:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787599758.449443:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787599758.449456:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787599758.449469:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787599758.449482:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787599758.449497:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787599758.453106:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787599758.453175:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787599758.453205:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787599758.453212:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787599758.453335:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599758.453400:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.453452:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599758.455333:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091136 00000100:00100000:0.0:1787599758.455348:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091136 00000100:00100000:0.0:1787599758.455419:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787599758.455429:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599758.455625:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091136:12345-0@lo:501:mount.lustre.0 Request processed in 192us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.455634:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787599758.456186:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599758.456236:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599758.456294:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.456324:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091264 00000100:00100000:1.0:1787599758.456336:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091264 00000100:00100000:1.0:1787599758.456374:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787599758.456382:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599758.456472:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091264:12345-0@lo:503:mount.lustre.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599758.456479:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787599758.456524:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599758.456537:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787599758.460196:0:24161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599758.460297:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599758.460381:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.460440:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16540 going to sleep for 11 seconds 00000100:00100000:2.0:1787599758.460592:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091392 00000100:00100000:2.0:1787599758.460599:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091392 00000100:00100000:2.0:1787599758.460640:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787599758.460649:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599758.460768:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091392:12345-0@lo:502:mount.lustre.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.460785:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787599758.461044:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599758.461208:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787599758.461242:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787599758.461254:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787599758.461265:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787599758.461275:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787599758.461285:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787599758.461296:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787599758.461306:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787599758.461316:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787599758.461326:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787599758.461336:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787599758.461347:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787599758.461357:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787599758.461368:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787599758.461379:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787599758.461397:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787599758.461407:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787599758.461428:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787599758.461441:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787599758.461455:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787599758.461467:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787599758.461479:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787599758.461491:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787599758.461505:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787599758.461517:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787599758.461528:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787599758.461538:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787599758.461548:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787599758.461559:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787599758.461569:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787599758.461594:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787599758.461605:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787599758.461615:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787599758.461637:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787599758.461649:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787599758.461659:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787599758.461669:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787599758.461680:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787599758.461691:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787599758.461701:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787599758.461711:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787599758.461721:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787599758.461731:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787599758.464593:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787599758.464647:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787599758.464659:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787599758.464671:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787599758.464683:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787599758.467809:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599758.467899:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.468048:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091520 00000100:00100000:0.0:1787599758.468056:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091520 00000100:00100000:0.0:1787599758.468108:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787599758.468116:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599758.468224:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091520:12345-0@lo:502:mount.lustre.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.468232:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787599758.468846:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16540 going to sleep for 11 seconds 00000100:00100000:1.0:1787599758.468872:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599758.470291:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787599758.470333:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787599758.470374:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599758.470446:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.470492:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34de16540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599758.472877:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091648 00000100:00100000:0.0:1787599758.472895:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091648 00000100:00100000:0.0:1787599758.472980:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787599758.472992:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599758.473156:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578091648:12345-0@lo:502:mount.lustre.0 Request processed in 166us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.473164:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787599758.473432:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578091648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787599758.473524:0:24161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787599758.473540:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787599758.484084:0:24187:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787599758.484106:0:24187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96b3810db370) 00000020:00000080:2.0:1787599758.484129:0:24187:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1787599758.484503:0:24187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f892000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599758.484508:0:24187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f892000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787599758.484511:0:24187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f892000 3 00010000:00080000:2.0:1787599758.484540:0:24187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b24337f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.101@tcp at head 00010000:00010000:2.0:1787599758.490729:0:24187:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787599758.491105:0:24187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787599758.491149:0:24187:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787599758.491164:0:24187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d2988b0929d0ef2 00000100:00080000:2.0:1787599758.491174:0:24187:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787599758.491180:0:24187:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96b24337f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599758.491216:0:24187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ace00 x1874433578091776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599758.491239:0:24187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787599758.491280:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.491284:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.491286:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.491289:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.491309:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.491312:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.491315:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.491324:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599758.491483:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578091904:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.491550:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.491605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599758.491611:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578092288:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.491634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.491664:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578092160:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.491685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.491701:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599758.491706:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578092032:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.491726:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599758.491989:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092288 00000100:00100000:0.0:1787599758.491998:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092288 00000100:00100000:0.0:1787599758.492044:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092032 00000100:00100000:0.0:1787599758.492047:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092032 00000100:00100000:0.0:1787599758.492063:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599758.492079:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.492139:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578092288:12345-0@lo:400:kworker.0 Request processed in 61us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.492147:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599758.492164:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599758.492170:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578092032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.492202:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578092032:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.492208:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599758.492228:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091904 00000100:00100000:0.0:1787599758.492232:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091904 00000100:00100000:0.0:1787599758.492247:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092160 00000100:00100000:0.0:1787599758.492249:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092160 00000100:00100000:0.0:1787599758.492261:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599758.492267:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578091904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.492298:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578091904:12345-0@lo:400:kworker.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.492305:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787599758.492316:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787599758.492323:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578092160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.492347:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578092160:12345-0@lo:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.492352:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787599758.493453:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578091776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599758.493507:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787599758.493775:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2433aed80 x1874433578092032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599758.493901:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578092032:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.493929:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578092160:0@lo:400:kworker.0 00010000:00080000:0.0:1787599758.493964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2433af480 x1874433578092288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599758.493974:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578092288:0@lo:400:kworker.0 00000100:00100000:0.0:1787599758.493985:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578091904:0@lo:400:kworker.0 00000020:01000004:0.0:1787599758.495016:0:24187:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787599758.495034:0:24187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96b242c3cd28) 00000020:00000080:0.0:1787599758.495058:0:24187:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787599758.495151:0:24187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b37f892000 from lustre-OST0000, refs=3 00000100:00100000:1.0:1787599758.495155:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578091776 00000020:01000004:0.0:1787599758.495155:0:24187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b37f892000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787599758.495157:0:24187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b37f892000 3 00000100:00100000:1.0:1787599758.495163:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578091776 00010000:00080000:0.0:1787599758.495184:0:24187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b36e511000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.101@tcp at head 00000100:00100000:1.0:1787599758.495196:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599758.495203:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578091776:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787599758.495228:0:22659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1787599758.495256:0:22659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d2988b0929d0f00 00000004:00100000:1.0:1787599758.495272:0:22659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599758.495302:0:22659:0:(import.c:65:import_set_state_nolock()) ffff96b2443d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599758.495379:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1874433578091776:12345-0@lo:38:llog_process_th.0 Request processed in 175us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599758.495386:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787599758.495428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b2433ace00 x1874433578091776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599758.495438:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599758.495451:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787599758.495458:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787599758.495462:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787599758.495465:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24337f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599758.495471:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1874433578091776:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1787599758.498494:0:24187:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787599758.498696:0:24187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787599758.499012:0:24187:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787599758.499026:0:24187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5d2988b0929d0f07 00000100:00080000:1.0:1787599758.499036:0:24187:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787599758.499041:0:24187:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff96b36e511000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599758.499075:0:24187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b351768380 x1874433578092416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599758.499113:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578092416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787599758.499178:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787599758.499231:0:24187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787599758.499677:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.499682:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.499685:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.499687:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.499691:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.499693:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599758.499696:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599758.499698:0:13886:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599758.500870:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092416 00000100:00100000:1.0:1787599758.500882:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092416 00000100:00100000:1.0:1787599758.500936:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599758.500952:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578092416:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787599758.500982:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1787599758.501031:0:22662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5d2988b0929d0f0e 00000004:00100000:1.0:1787599758.501048:0:22662:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787599758.501081:0:22662:0:(import.c:65:import_set_state_nolock()) ffff96b2443da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599758.501153:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1874433578092416:12345-0@lo:38:llog_process_th.0 Request processed in 209us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599758.501167:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787599758.501219:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96b351768380 x1874433578092416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599758.501230:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599758.501237:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1787599758.501244:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787599758.501249:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787599758.501251:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b36e511000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787599758.501256:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1874433578092416:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787599758.504990:0:24187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787599758.505086:0:24161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787599758.505120:0:24161:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787599758.505146:0:24161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ee4 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.505158:0:24161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54be00/0x5d2988b0929d0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0ee4 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787599758.505205:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787599758.505207:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599758.505209:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599758.505210:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599758.505211:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599758.505213:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599758.505214:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599758.505216:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599758.505217:0:24161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599758.505221:0:24161:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787599758.505223:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787599758.505225:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599758.505226:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599758.505227:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599758.505228:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599758.505229:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599758.505230:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599758.505231:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599758.505232:0:24161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787599758.505258:0:24161:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787599758.505277:0:24161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578092544:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787599758.505350:0:24161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599758.505395:0:24161:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b38130b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599758.505951:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092544 00000100:00100000:1.0:1787599758.505959:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092544 00000100:00100000:1.0:1787599758.506012:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787599758.506022:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24161:x1874433578092544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787599758.506050:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787599758.506063:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787599758.507661:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787599758.507677:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787599758.508074:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787599758.508079:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787599758.508100:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508118:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508126:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508134:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508176:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508188:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 21 pid: 22655 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599758.508200:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578092672:0@lo:104: 00000100:00100000:1.0:1787599758.508256:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599758.508582:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.508591:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 21 pid: 22654 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599758.508598:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578092800:0@lo:104: 00000100:00100000:1.0:1787599758.508621:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599758.509161:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34dc4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599758.509201:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787599758.509228:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092672 00000100:00100000:0.0:1787599758.509235:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092672 00000100:00100000:2.0:1787599758.509292:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092800 00000100:00100000:2.0:1787599758.509297:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092800 00000100:00100000:2.0:1787599758.509319:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599758.509329:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578092672:12345-0@lo:104: 00010000:00010000:2.0:1787599758.509344:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.509421:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787599758.509427:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578092672:12345-0@lo:104: Request processed in 100us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.509443:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599758.509461:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599758.509467:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3471bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578092800:12345-0@lo:104: 00010000:00010000:2.0:1787599758.509474:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.509507:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599758.509515:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.509518:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787599758.509523:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc114bc20) 00000100:00100000:2.0:1787599758.509523:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3471bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578092800:12345-0@lo:104: Request processed in 57us (902us total) trans 0 rc 0/0 10000000:00010000:3.0:1787599758.509527:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599758.509529:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787599758.509536:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787599758.509542:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599758.509547:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787599758.509563:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599758.509586:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.509592:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787599758.509612:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.509618:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c800/0x5d2988b0929d0e66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e6d expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.509628:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599758.509630:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599758.509631:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599758.509774:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351768380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578092672:0@lo:104: 00000100:00100000:1.0:1787599758.509783:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578092800:0@lo:104: 00010000:00010000:1.0:1787599758.509896:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599758.510116:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599758.510125:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599758.510127:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599758.510162:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.510171:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:1.0:1787599758.510174:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.510189:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787599758.510196:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599758.510201:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787599758.510231:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.510237:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787599758.510255:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.510262:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3c400/0x5d2988b0929d0e58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e5f expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.510277:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599758.510279:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599758.510280:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599758.510292:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578093056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599758.510328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.510436:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093056 00000100:00100000:2.0:1787599758.510443:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093056 00010000:00010000:2.0:1787599758.510465:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 22 pid: 22654 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599758.510526:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599758.510534:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:3647:x1874433578093056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599758.510545:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599758.510550:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 22 pid: 22654 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.510560:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 22 pid: 22654 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.510585:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200c400/0x5d2988b0929d0e5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e58 expref: 22 pid: 22654 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.510597:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599758.510637:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578093056:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.510643:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599758.510729:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:24161:x1874433578092544:12345-0@lo:253:mount.lustre.0 Request processed in 4708us (5378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599758.510739:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787599758.510772:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578092928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599758.511109:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578093056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787599758.511168:0:24161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24161:1874433578092544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599758.511180:0:24161:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787599758.511183:0:24161:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599758.511185:0:24161:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787599758.511186:0:24161:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599758.511187:0:24161:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599758.511188:0:24161:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599758.511189:0:24161:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599758.511191:0:24161:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599758.511192:0:24161:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599758.511194:0:24161:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599758.511205:0:24161:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787599758.512703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599758.513086:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578092928 00000100:00100000:2.0:1787599758.513096:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578092928 00010000:00010000:2.0:1787599758.513129:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 20 pid: 22655 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599758.513190:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599758.513199:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:3646:x1874433578092928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787599758.513211:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599758.513216:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 20 pid: 22655 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513226:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 20 pid: 22655 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513241:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6600/0x5d2988b0929d0e6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e66 expref: 20 pid: 22655 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513254:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513261:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787599758.513276:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013577406s 00010000:00010000:2.0:1787599758.513281:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513287:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513294:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513300:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513312:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ba00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599758.513316:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513323:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.513497:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599758.513505:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513548:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513557:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d0f15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599758.513580:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599758.513685:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f91a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:3646:x1874433578092928:12345-0@lo:103:ldlm_bl.0 Request processed in 486us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599758.513692:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787599758.513787:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578092928:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787599758.515858:0:24161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787599758.520098:0:24161:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787599758.520109:0:24161:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787599758.520156:0:24161:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787599758.520198:0:24161:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787599758.520218:0:24161:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787599758.520249:0:24161:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787599758.521175:0:24161:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599758.521377:0:24161:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599758.693467:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599759.461451:0:24242:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599759.461683:0:24242:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787599759.590940:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599759.590948:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f896800 from 13 10000000:01000000:2.0:1787599759.590954:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599759.591003:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.591014:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.591028:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599759.591069:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599759.591144:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599759.591192:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ead80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599759.591457:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093184 00000100:00100000:0.0:1787599759.591464:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093184 00000100:00100000:0.0:1787599759.591515:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787599759.591525:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+19:22657:x1874433578093184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599759.591539:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599759.591552:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0f1c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599759.591587:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599759.591597:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 20 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599759.591606:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d400, rc 0) 00000100:00100000:0.0:1787599759.591657:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:22657:x1874433578093184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599759.591664:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787599759.592062:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599759.592079:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.592089:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599759.592147:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787599759.592180:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599759.592201:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599759.592358:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093312 00000100:00100000:1.0:1787599759.592364:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093312 00000100:00100000:1.0:1787599759.592403:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787599759.592412:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:22657:x1874433578093312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599759.592427:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599759.592445:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599759.592448:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787599759.592528:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:22657:x1874433578093312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599759.592536:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787599759.592745:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787599759.592843:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599759.592851:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.592860:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599759.592871:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787599759.592873:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b344b34800 from 13 10000000:01000000:2.0:1787599759.592876:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787599759.592900:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.592918:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.592929:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599759.592943:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787599759.592973:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599759.592994:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599759.593008:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093440 00000100:00100000:2.0:1787599759.593012:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093440 00000100:00100000:2.0:1787599759.593033:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599759.593041:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:22657:x1874433578093440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599759.593049:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599759.593059:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d0f2a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.593075:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.593083:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.593091:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6400, rc 0) 00000100:00100000:2.0:1787599759.593121:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578093440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599759.593128:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787599759.593164:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599759.593174:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.593183:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599759.593218:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787599759.593247:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599759.593261:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1787599759.593272:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093568 00000100:00100000:2.0:1787599759.593276:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093568 00000100:00100000:2.0:1787599759.593292:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599759.593297:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578093568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787599759.593307:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787599759.593322:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787599759.593325:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787599759.593392:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578093568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599759.593400:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787599759.593427:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578093568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787599759.593467:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787599759.593473:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599759.593481:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599759.722719:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599760.742229:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599760.935547:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599760.935584:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578093696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599760.935669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599760.935710:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599760.935719:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599760.935747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599760.935778:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093696 00000100:00100000:1.0:1787599760.935787:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093696 00000100:00100000:1.0:1787599760.935864:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093824 00000100:00100000:1.0:1787599760.935868:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093824 00000100:00100000:1.0:1787599760.935885:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599760.935893:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578093696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599760.935926:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599760.935966:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578093696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599760.935987:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787599760.936005:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599760.936011:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578093824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599760.936029:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787599760.936062:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b35176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578093824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599760.936068:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599760.936110:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599760.936138:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578093696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787599761.765669:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599762.790453:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787599762.856756:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787599763.814829:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787599764.006441:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599764.006448:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599764.006451:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599764.006455:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599764.006470:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599764.006473:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787599764.006476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599764.006478:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787599764.006517:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578094080:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.006596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599764.006642:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578094592:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.006676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599764.006705:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787599764.006711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578094208:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.006734:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599764.006751:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578094720:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.006773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599764.006832:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094080 00000100:00100000:1.0:1787599764.006841:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094080 00000100:00100000:1.0:1787599764.006889:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599764.006899:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578094080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.006956:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578094080:12345-0@lo:400:kworker.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.006964:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787599764.006987:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094592 00000100:00100000:1.0:1787599764.006991:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094592 00000100:00100000:1.0:1787599764.007021:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094208 00000100:00100000:1.0:1787599764.007025:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094208 00000100:00100000:1.0:1787599764.007036:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094720 00000100:00100000:1.0:1787599764.007038:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094720 00000100:00100000:1.0:1787599764.007054:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599764.007060:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578094592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007091:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578094592:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007097:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787599764.007108:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599764.007114:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007140:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578094208:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007152:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599764.007166:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599764.007172:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578094720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007202:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578094720:12345-0@lo:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007207:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787599764.007259:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599764.007264:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787599764.007293:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c3480 x1874433578094208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599764.007309:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578094208:0@lo:400:kworker.0 00010000:00080000:1.0:1787599764.007320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c0000 x1874433578094720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599764.007329:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578094720:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007338:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578094080:0@lo:400:kworker.0 00010000:00080000:1.0:1787599764.007347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c0700 x1874433578094592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599764.007355:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578094592:0@lo:400:kworker.0 00000100:00100000:3.0:1787599764.007451:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578093952:0@lo:400:kworker.0 00000100:00100000:3.0:1787599764.007487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599764.007534:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578094464:0@lo:400:kworker.0 00000100:00100000:3.0:1787599764.007558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599764.007574:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787599764.007580:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578094336:0@lo:400:kworker.0 00000100:00100000:3.0:1787599764.007602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599764.007657:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578093952 00000100:00100000:1.0:1787599764.007661:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578093952 00000100:00100000:1.0:1787599764.007700:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599764.007708:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3646:x1874433578093952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007743:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3646:x1874433578093952:12345-0@lo:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007757:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787599764.007782:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094336 00000100:00100000:1.0:1787599764.007786:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094336 00000100:00100000:1.0:1787599764.007837:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599764.007844:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578094336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007873:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578094336:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007878:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787599764.007905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578094336:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007913:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578093952:0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007930:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094464 00000100:00100000:1.0:1787599764.007933:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094464 00000100:00100000:1.0:1787599764.007955:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599764.007961:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578094464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599764.007994:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578094464:12345-0@lo:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599764.007999:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787599764.008024:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c2a00 x1874433578094464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599764.008033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578094464:0@lo:400:kworker.0 00010000:00010000:1.0:1787599764.837053:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599765.289544:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599765.668967:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599750/real 1787599750] req@ffff96b377b0dc00 x1874433578087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599765.669001:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b377b0dc00 x1874433578087552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599765.669030:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599750/real 1787599750] req@ffff96b377b0d180 x1874433578087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599765.669043:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b377b0d180 x1874433578087680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599765.669062:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b377b8f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599765.669130:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599765.669134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578087552:0@lo:8:kworker.0 00000100:00080000:1.0:1787599765.669139:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599765.669233:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599765.669238:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599765.669241:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599765.669244:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787599765.669272:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599765.669275:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787599765.669278:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b377b8f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599765.669284:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787599765.669289:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787599765.669295:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96b377b8f800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599765.669315:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ac380 x1874433578095360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599765.669324:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599765.669327:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599765.669329:0:38:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599765.669332:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787599765.669334:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787599765.669338:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599765.669347:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433afb80 x1874433578095488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599765.669403:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578094976:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669505:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578095744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669571:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787599765.669578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578094848:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669634:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578095616:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669697:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578095232:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787599765.669746:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578095104:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669769:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.669787:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578095872:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.669843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599765.671907:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094848 00000100:00100000:2.0:1787599765.671922:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094848 00000100:00100000:2.0:1787599765.672017:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787599765.672028:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3646:x1874433578094848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.672113:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3646:x1874433578094848:12345-0@lo:400:kworker.0 Request processed in 87us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599765.672120:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787599765.673788:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787599765.673811:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578087680:0@lo:8:kworker.0 00000100:00100000:1.0:1787599765.673852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578095360:0@lo:8:kworker.0 00000100:00100000:1.0:1787599765.673922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599765.673963:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578095488:0@lo:8:kworker.0 00000100:00100000:1.0:1787599765.673985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599765.674029:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578094976 00000100:00100000:1.0:1787599765.674036:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578094976 00000100:00100000:1.0:1787599765.674068:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095232 00000100:00100000:1.0:1787599765.674071:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095232 00000100:00100000:1.0:1787599765.674083:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599765.674091:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.674137:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578094976:12345-0@lo:400:kworker.0 Request processed in 46us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.674145:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787599765.674161:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599765.674176:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578095232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.674536:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578095232:12345-0@lo:400:kworker.0 Request processed in 359us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.674543:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787599765.674565:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095744 00000100:00100000:1.0:1787599765.674569:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095744 00000100:00100000:1.0:1787599765.674588:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095616 00000100:00100000:1.0:1787599765.674591:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095616 00000100:00100000:1.0:1787599765.674602:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095104 00000100:00100000:1.0:1787599765.674605:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095104 00000100:00100000:1.0:1787599765.674614:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095872 00000100:00100000:1.0:1787599765.674617:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095872 00000100:00100000:1.0:1787599765.674630:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599765.674637:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578095744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.674668:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578095744:12345-0@lo:400:kworker.0 Request processed in 31us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.675283:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599765.675304:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599765.675311:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578095616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.675347:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578095616:12345-0@lo:400:kworker.0 Request processed in 38us (5689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.675353:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599765.675362:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599765.675367:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578095104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.675388:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874433578095104:12345-0@lo:400:kworker.0 Request processed in 22us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.675393:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599765.675409:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599765.675413:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578095872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.675436:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578095872:12345-0@lo:400:kworker.0 Request processed in 23us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.675441:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787599765.675491:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433af100 x1874433578095104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599765.675505:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874433578095104:0@lo:400:kworker.0 00010000:00080000:1.0:1787599765.675526:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433af480 x1874433578095872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599765.675534:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578095872:0@lo:400:kworker.0 00000100:00100000:1.0:1787599765.675546:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578095232:0@lo:400:kworker.0 00000100:00080000:0.0:1787599765.675859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599765.675864:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787599765.675867:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787599765.675870:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787599765.675899:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578094848:0@lo:400:kworker.0 00010000:00080000:0.0:1787599765.675912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433ace00 x1874433578095616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599765.675935:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578095616:0@lo:400:kworker.0 00000100:00100000:0.0:1787599765.675951:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578094976:0@lo:400:kworker.0 00010000:00080000:0.0:1787599765.675965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433ac000 x1874433578095744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599765.675973:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578095744:0@lo:400:kworker.0 00000100:00100000:2.0:1787599765.676919:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095360 00000100:00100000:2.0:1787599765.676929:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095360 00000100:00100000:2.0:1787599765.676965:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578095488 00000100:00100000:2.0:1787599765.676968:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578095488 00000100:00100000:2.0:1787599765.676986:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599765.676993:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578095360:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787599765.677023:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:2.0:1787599765.677050:0:24165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d0f38 00002000:00100000:2.0:1787599765.677064:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff96b24337f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787599765.677068:0:24165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787599765.677071:0:24165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787599765.677242:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787599765.677266:0:24165:0:(import.c:65:import_set_state_nolock()) ffff96b243378800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599765.677334:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578095360:12345-0@lo:8:kworker.0 Request processed in 341us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599765.677341:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787599765.677358:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599765.677362:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578095488:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787599765.677373:0:24165:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787599765.685880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433ac380 x1874433578095360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.685912:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599765.685925:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787599765.685933:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787599765.685941:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787599765.685944:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b377b8f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787599765.685968:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787599765.685975:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578095360:0@lo:8:kworker.0 00000004:00080000:1.0:1787599765.686186:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787599765.686211:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096128:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787599765.686284:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599765.686315:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787599765.686332:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599765.686425:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 712305631889ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787599765.686432:0:23403:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787599765.686456:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599765.686469:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578096000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599765.686493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599765.686541:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787599765.686548:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787599765.686852:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096128 00000100:00100000:1.0:1787599765.686865:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096128 00000100:00080000:1.0:1787599765.686921:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599765.687007:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787599765.687018:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23404:x1874433578096128:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787599765.688446:0:23395:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787599765.688858:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096000 00000100:00100000:3.0:1787599765.688867:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096000 00000100:00100000:3.0:1787599765.688910:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599765.688920:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874433578096000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599765.688946:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599765.689030:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1874433578096000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599765.689037:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787599765.689080:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c0700 x1874433578096000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.689100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578096000:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1787599765.694727:0:24501:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787599765.694735:0:24501:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787599765.694865:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23404:x1874433578096128:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7844us (8576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599765.694875:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787599765.694969:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b34e5c2d80 x1874433578096128/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.694985:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096128:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787599765.694998:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787599765.695033:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096256:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787599765.695064:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599765.695101:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599765.695141:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096256 00000100:00100000:1.0:1787599765.695147:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096256 00000100:00100000:3.0:1787599765.695268:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599765.695278:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23404:x1874433578096256:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787599765.695302:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787599765.695331:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23404:x1874433578096256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599765.695338:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787599765.695360:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377b0d180 x1874433578096256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.695369:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096256:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787599765.695377:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787599765.695397:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096384:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787599765.695417:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599765.695431:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599765.696769:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096384 00000100:00100000:1.0:1787599765.696780:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096384 00000100:00100000:1.0:1787599765.696852:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787599765.696871:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1874433578096384:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787599765.696914:0:24168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787599765.726961:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578095488:12345-0@lo:8:kworker.0 Request processed in 49591us (52967us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599765.726975:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787599765.732116:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599765.732127:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787599765.732132:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578095488:0@lo:8:kworker.0 00000001:00080000:0.0:1787599765.734355:0:24162:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1787599765.734373:0:24162:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787599765.734617:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23404:x1874433578096384:12345-0@lo:5:osp-pre-0-1.0 Request processed in 37743us (39194us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787599765.734628:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787599765.734744:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377b0d180 x1874433578096384/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.734758:0:23404:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787599765.734766:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1874433578096384:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787599765.734783:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1787599765.734870:0:23404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874433578096512:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787599765.734906:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599765.734943:0:23404:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3514bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599765.735104:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096512 00000100:00100000:0.0:1787599765.735112:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096512 00000100:00100000:0.0:1787599765.735151:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787599765.735160:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874433578096512:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787599765.735325:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874433578096512:12345-0@lo:900:osp-pre-0-1.0 Request processed in 166us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599765.735333:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787599765.735390:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377b0d180 x1874433578096512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599765.735401:0:23404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874433578096512:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1787599765.866683:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787599766.038388:0:24533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787599766.054100:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578096640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599766.054291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599766.054429:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599766.054435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578096768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599766.054462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599766.063114:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096640 00000100:00100000:2.0:1787599766.063128:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096640 00000100:00100000:2.0:1787599766.063204:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096768 00000100:00100000:2.0:1787599766.063208:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096768 00000100:00100000:2.0:1787599766.063230:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599766.063240:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578096640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599766.063284:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599766.063383:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578096640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (9203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599766.063391:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599766.063409:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599766.063415:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578096768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599766.063432:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599766.063464:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578096768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (9001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599766.063470:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787599766.064879:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578096768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599766.064900:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578096640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787599766.890402:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599767.003771:0:24585:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599767.004443:0:24585:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787599767.806136:0:24636:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599767.806400:0:24636:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599767.909484:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599768.740870:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599748/real 1787599748] req@ffff96b377b0ce00 x1874433578085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.740898:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b377b0ce00 x1874433578085888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.740908:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787599748/real 1787599748] req@ffff96b377b0df80 x1874433578086016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.740920:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96b377b0df80 x1874433578086016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787599768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787599768.740941:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599768.740961:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599768.740965:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578085888:0@lo:8:kworker.0 00000100:00080000:2.0:1787599768.740971:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599768.740976:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787599768.740979:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578086016:0@lo:8:kworker.0 00000100:00080000:3.0:1787599768.741295:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787599768.741299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578096896:0@lo:400:kworker.0 00000100:00080000:3.0:1787599768.741300:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787599768.741303:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599768.741308:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 695 00000100:00080000:3.0:1787599768.741312:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599768.741318:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96b3707b3000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599768.741335:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0df80 x1874433578097152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599768.741348:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599768.741351:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599768.741352:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599768.741355:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 695 00000100:00080000:3.0:1787599768.741358:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599768.741361:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599768.741361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.741371:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0ce00 x1874433578097280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599768.741398:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787599768.741403:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787599768.741404:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578097024:0@lo:400:kworker.0 00000100:00080000:3.0:1787599768.741407:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599768.741408:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599768.741411:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 712 00000100:00080000:3.0:1787599768.741420:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787599768.741423:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599768.741428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.741435:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24347b480 x1874433578097792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787599768.741444:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578097664:0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.741473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.741474:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578096896 00000100:00100000:3.0:1787599768.741480:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578096896 00000100:00100000:1.0:1787599768.741504:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599768.741510:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578097920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.741532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.741549:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787599768.741557:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097920 00000100:00100000:3.0:1787599768.741558:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.741560:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097920 00000100:00100000:1.0:1787599768.741584:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599768.741590:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741605:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578096896:12345-0@lo:400:kworker.0 Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599768.741612:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787599768.741643:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578097408:0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.741682:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578098048:0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.741711:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097024 00000100:00100000:3.0:1787599768.741714:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599768.741715:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097024 00000100:00100000:3.0:1787599768.741718:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578097536:0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.741741:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787599768.741747:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741748:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578098176:0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.741779:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578097024:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599768.741784:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787599768.741819:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097664 00000100:00100000:3.0:1787599768.741822:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097664 00000100:00100000:2.0:1787599768.741827:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097536 00000100:00100000:2.0:1787599768.741829:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097536 00000100:00100000:2.0:1787599768.741842:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787599768.741847:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578097536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741852:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599768.741858:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578097664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599768.741878:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578097536:12345-0@lo:400:kworker.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599768.741882:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578097664:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599768.741884:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599768.741893:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787599768.741913:0:22662:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787599768.741920:0:22662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1787599768.741946:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599768.741973:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578097536:0@lo:400:kworker.0 00000100:00100000:3.0:1787599768.741989:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578097152:0@lo:8:kworker.0 00000100:00100000:3.0:1787599768.742011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.742031:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097152 00000100:00100000:3.0:1787599768.742032:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578097280:0@lo:8:kworker.0 00000100:00100000:2.0:1787599768.742034:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097152 00000100:00100000:3.0:1787599768.742051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.742053:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599768.742057:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578097152:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787599768.742063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578097792:0@lo:8:kworker.0 00000100:00100000:3.0:1787599768.742079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787599768.742079:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 715 last 0 00000100:00100000:3.0:1787599768.742095:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097280 00000100:00100000:3.0:1787599768.742098:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097280 00000020:00000080:2.0:1787599768.742105:0:24165:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d0f3f 00000100:00100000:3.0:1787599768.742106:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097792 00000100:00100000:3.0:1787599768.742108:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097792 00000100:00100000:3.0:1787599768.742116:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00002000:00100000:2.0:1787599768.742118:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96b24337d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1787599768.742120:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578097280:12345-0@lo:8:kworker.0 00002000:00080000:2.0:1787599768.742122:0:24165:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787599768.742124:0:24165:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00020000:3.0:1787599768.742130:0:24167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787599768.742240:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578097920:12345-0@lo:400:kworker.0 Request processed in 649us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599768.742247:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599768.742259:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578097408 00000100:00100000:1.0:1787599768.742263:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578097408 00000100:00100000:1.0:1787599768.742275:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098048 00000100:00100000:1.0:1787599768.742277:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098048 00000100:00100000:1.0:1787599768.742294:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098176 00000100:00100000:1.0:1787599768.742297:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098176 00000100:00100000:1.0:1787599768.742309:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599768.742314:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.742346:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578097408:12345-0@lo:400:kworker.0 Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599768.742352:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599768.742362:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599768.742367:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.742390:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578098048:12345-0@lo:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599768.742396:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599768.742413:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787599768.742419:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599768.742445:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578098176:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599768.742450:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00080000:2.0:1787599768.742525:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599768.742546:0:24165:0:(import.c:65:import_set_state_nolock()) ffff96b24337e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599768.742589:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578097152:12345-0@lo:8:kworker.0 Request processed in 530us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599768.742601:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787599768.742614:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787599768.742750:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b377b0df80 x1874433578097152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599768.742759:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787599768.742765:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787599768.742773:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599768.742778:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787599768.742780:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707b3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599768.742808:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599768.742813:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578097152:0@lo:8:kworker.0 00000004:00080000:1.0:1787599768.742835:0:22684:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599768.742893:0:22684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 715362100222ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787599768.742899:0:22684:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787599768.743393:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578097792:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787599768.743408:0:24165:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787599768.743450:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578097792:12345-0@lo:8:kworker.0 Request processed in 59us (1370us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599768.743455:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599768.743603:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578097280:12345-0@lo:8:kworker.0 Request processed in 1480us (1549us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787599768.743611:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787599768.743665:0:22685:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787599768.743683:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874433578098432:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787599768.743711:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599768.743714:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599768.743722:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578098304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599768.743732:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b370672240 going to sleep for 11 seconds 00000100:00100000:3.0:1787599768.743753:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098432 00000100:00100000:2.0:1787599768.743753:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599768.743759:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098432 00000100:00100000:3.0:1787599768.743815:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787599768.743822:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22685:x1874433578098432:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787599768.744740:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599768.744747:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599768.744751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578097280:0@lo:8:kworker.0 00000100:00080000:1.0:1787599768.744761:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787599768.744764:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787599768.744767:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578097792:0@lo:8:kworker.0 00000100:00080000:2.0:1787599768.744848:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599768.744853:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599768.744856:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787599768.744881:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347b800 x1874433578098176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.744893:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578098176:0@lo:400:kworker.0 00010000:00080000:2.0:1787599768.744905:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243479c00 x1874433578097408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.744913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578097408:0@lo:400:kworker.0 00010000:00080000:2.0:1787599768.744924:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243479180 x1874433578098048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.744931:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578098048:0@lo:400:kworker.0 00010000:00080000:2.0:1787599768.744958:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243478a80 x1874433578097920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.744979:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578097920:0@lo:400:kworker.0 00010000:00080000:2.0:1787599768.744997:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243478000 x1874433578097664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.745005:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578097664:0@lo:400:kworker.0 00000100:00100000:2.0:1787599768.745016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578097024:0@lo:400:kworker.0 00000100:00100000:2.0:1787599768.745028:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578096896:0@lo:400:kworker.0 00000004:00080000:1.0:1787599768.745146:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787599768.745422:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098304 00000100:00100000:3.0:1787599768.745429:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098304 00000100:00100000:3.0:1787599768.745474:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787599768.745493:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433578098304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599768.745518:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599768.745660:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874433578098304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599768.745668:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787599768.745710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347bb80 x1874433578098304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599768.745727:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578098304:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787599768.747687:0:24501:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787599768.747698:0:24501:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1787599768.747708:0:24501:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00002000:00010000:1.0:1787599768.760325:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599768.760337:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.760355:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=715s v=(0 0) 00010000:00010000:1.0:1787599768.760360:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599768.760368:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.760386:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.760397:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.760405:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.760426:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787599768.765844:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.765859:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.765876:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.765881:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.765887:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.765904:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.765914:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.765935:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.765960:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787599768.766033:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787599768.766042:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766050:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54a000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.766054:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766063:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766082:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766089:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000485de19f/0x5d2988b0929d0f46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766114:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.766117:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766123:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.766126:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766134:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766145:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766152:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0f4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766175:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.766177:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.766179:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.766465:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.766472:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766479:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.766494:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.766498:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766508:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766517:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766524:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766544:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.766615:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.766621:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766628:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.766638:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766646:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766657:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766664:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0f54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.766678:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.766680:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.766682:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.766884:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.766906:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.766912:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766926:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.766929:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.766933:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766941:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766947:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766954:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.766973:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.767045:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.767049:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.767057:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.767060:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.767068:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.767080:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.767094:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0f5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.767108:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.767110:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.767112:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.767530:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.767537:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.767545:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.767548:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.767552:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.767561:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.767580:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.767587:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.767606:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.767872:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.767877:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.767885:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.767888:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.767901:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.767914:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.767921:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0f62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.767936:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.767937:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.767939:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.771474:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.771501:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.771519:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.771524:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.771531:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.771555:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.771566:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.771574:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.771597:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599768.772134:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599768.772142:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.772151:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599768.772157:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.772166:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.772184:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.772191:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000691efe68/0x5d2988b0929d0f69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.772207:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.772215:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.772217:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.772499:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.772511:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772519:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.772523:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.772528:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772537:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772546:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772553:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772571:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.772604:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.772610:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.772618:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.772622:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.772629:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.772642:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.772649:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bee6e86/0x5d2988b0929d0f70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.772663:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.772664:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.772666:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.772912:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.772919:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772928:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.772931:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.772935:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772945:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772958:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772965:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.772986:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.773054:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.773059:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773068:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.773071:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773092:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773103:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773111:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009050b427/0x5d2988b0929d0f77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773125:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.773126:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.773128:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.773376:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.773382:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773391:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.773394:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.773398:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773407:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773414:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773420:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773453:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.773508:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.773513:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773521:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.773524:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773532:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773555:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773575:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057d73427/0x5d2988b0929d0f7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.773588:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.773590:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.773591:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.773863:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.773869:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773878:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.773881:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.773886:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773894:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773902:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773910:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.773929:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599768.774505:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.774512:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.774521:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.774529:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.774536:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.774546:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.774554:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.774560:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.774927:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599768.774934:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.774942:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599768.774946:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.774953:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.774968:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.775054:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029392708/0x5d2988b0929d0f85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.775081:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.775083:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.775085:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.775382:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.775393:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.775397:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.775404:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.775407:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.775414:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.775424:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.775439:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae9fafba/0x5d2988b0929d0f8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.775462:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.775464:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.775466:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.776010:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.776018:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776028:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.776032:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.776037:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776046:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776054:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776061:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776077:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.776085:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.776094:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776101:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.776104:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776111:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776123:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776130:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeedcaad/0x5d2988b0929d0f93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.776148:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.776150:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.776151:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.777342:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.777351:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.777363:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.777366:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.777371:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.777392:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.777401:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.777408:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.777433:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.777517:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.777524:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.777532:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.777606:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.777615:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.777629:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.777636:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ea916a9/0x5d2988b0929d0f9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.777661:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.777663:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.777665:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.778398:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.778406:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.778416:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.778420:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.778424:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.778434:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.778443:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.778460:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.778490:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.778614:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.778621:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.778629:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.778632:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.778639:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.778653:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.778672:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cc32c22/0x5d2988b0929d0fa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.778695:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.778697:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.778698:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.779343:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.779352:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779361:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.779365:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.779369:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779379:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779387:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779393:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779416:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.779514:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.779520:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.779528:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.779532:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.779608:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.779621:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.779629:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d672467/0x5d2988b0929d0fa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.779649:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.779651:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.779652:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.779907:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.779913:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779926:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.779929:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.779933:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779943:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779951:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779959:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.779982:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.780054:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.780060:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.780067:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.780071:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.780091:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.780103:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.780109:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c6808c8/0x5d2988b0929d0faf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.780126:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.780127:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.780129:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599768.780819:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599768.780828:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.780838:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=715s v=(0 0) 00010000:00010000:3.0:1787599768.780842:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599768.780847:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.780856:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.780875:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.780883:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.780904:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.781050:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.781056:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.781063:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.781067:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.781074:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.781086:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.781093:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005806aee8/0x5d2988b0929d0fb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.781119:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.781121:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.781122:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.784075:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.784088:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.784105:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.784110:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.784126:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.784142:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.784152:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.784159:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.784391:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787599768.785966:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.786134:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.786149:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.786153:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.786159:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787424:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.787439:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787452:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.787457:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787468:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787498:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787506:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095754359/0x5d2988b0929d0fbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.787530:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.787546:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.787548:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.787622:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.787632:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.787653:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.787675:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.787943:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.787950:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.787957:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.787961:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.787968:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.788071:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.788092:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d0fc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.788108:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.788110:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.788112:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.788306:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.788313:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788323:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.788327:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.788333:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788343:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788351:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788358:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788403:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.788527:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.788533:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.788541:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.788544:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.788551:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.788562:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.788570:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f809dadd/0x5d2988b0929d0fcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.788585:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.788587:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.788588:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.788762:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.788767:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788783:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.788786:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.788832:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788844:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788852:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788859:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.788874:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.789088:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.789093:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.789101:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.789105:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.789113:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.789124:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.789130:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d0fd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.789145:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.789146:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.789148:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.789781:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.789927:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.789939:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.789943:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.789948:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.789958:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790105:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790113:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790175:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.790441:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.790447:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.790455:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.790460:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.790468:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.790514:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.790522:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002359e7a2/0x5d2988b0929d0fd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.790538:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.790540:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.790542:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.790765:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.790772:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790782:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.790785:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.790891:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790904:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790913:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790920:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.790949:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.791084:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.791090:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.791097:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.791101:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.791121:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.791134:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.791141:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011a8ef0/0x5d2988b0929d0fe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.791158:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.791420:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.791422:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.791773:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.791781:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.791956:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.791960:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.791965:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792042:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792051:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792060:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792079:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.792294:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.792302:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.792310:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.792314:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.792330:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.792344:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.792352:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072c56523/0x5d2988b0929d0fe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.792369:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.792371:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.792373:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.792705:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.792713:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792722:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.792731:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.792741:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792751:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792759:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792766:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.792788:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.792875:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.792881:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.792888:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6da00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.792891:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.792900:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.792913:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.792921:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.792923:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.792925:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599768.792967:0:24501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d6777f/0x5d2988b0929d0fee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599768.793391:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.793398:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.793407:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.793410:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.793414:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.793424:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.793438:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.793444:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.793468:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.793593:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.793599:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.793607:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.793610:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.793619:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.793631:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.793651:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a47de9da/0x5d2988b0929d0ff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.793666:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.793667:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.793669:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.794061:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.794067:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794076:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.794080:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.794084:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794093:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794101:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794108:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794175:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.794342:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.794348:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.794356:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6cc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.794360:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.794367:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.794379:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.794398:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a28c6b8/0x5d2988b0929d0ffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.794413:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.794414:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.794416:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.794502:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.794507:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794516:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.794518:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.794522:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794531:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794539:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794546:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794566:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.794684:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.794690:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.794698:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.794701:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.794709:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.794733:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.794741:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f37f568c/0x5d2988b0929d1003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.794755:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.794757:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.794759:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.794953:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.794959:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.794967:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.795112:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.795117:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795128:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795137:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795145:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795163:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599768.795355:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.795361:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.795369:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6de00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.795372:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.795380:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.795392:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.795399:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0945eed/0x5d2988b0929d100a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.795413:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.795415:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.795416:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.795513:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.795519:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795527:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.795530:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.795534:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795544:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795551:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795566:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795615:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599768.795753:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599768.795759:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.795767:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599768.795771:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.795778:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599768.795916:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.795922:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795930:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.795933:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.795938:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795947:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795956:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795964:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.795991:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599768.796114:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599768.796119:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.796127:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599768.796131:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.796139:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.796151:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.796158:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abf95709/0x5d2988b0929d1018 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599768.796247:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.796249:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599768.796251:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599768.796381:0:24501:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599768.796386:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.796400:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=715s v=(0 0) 00010000:00010000:2.0:1787599768.796403:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599768.796407:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.796417:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.796424:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.796430:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599768.796451:0:24501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787599768.796696:0:24501:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1787599768.796831:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22685:x1874433578098432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53004us (53111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599768.796842:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787599768.796919:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599768.796925:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.796932:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599768.796935:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.796943:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.796956:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.796963:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd97845c/0x5d2988b0929d101f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599768.796986:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.796988:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599768.796989:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599768.797112:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874433578098432:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787599768.797128:0:22685:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787599768.797239:0:22685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874433578098560:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787599768.797278:0:22685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599768.797308:0:22685:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787599768.797353:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098560 00000100:00100000:2.0:1787599768.797360:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098560 00000100:00100000:2.0:1787599768.797406:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787599768.797414:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22685:x1874433578098560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787599768.797445:0:24168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1787599768.798153:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.798234:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d1011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599768.798254:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.798256:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599768.798257:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787599768.802230:0:24162:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1787599768.802282:0:24162:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787599768.802476:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22685:x1874433578098560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5059us (5194us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787599768.802501:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599768.802572:0:22685:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787599768.802581:0:22685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22685:1874433578098560:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787599768.802597:0:22685:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1787599768.936752:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599769.958181:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599770.984223:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599771.173037:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787599771.173066:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578098688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599771.173138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599771.173189:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098688 00000100:00100000:1.0:1787599771.173195:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098688 00000100:00100000:1.0:1787599771.173246:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599771.173267:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578098688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599771.173299:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599771.173347:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578098688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599771.173354:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787599771.173400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578098688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599771.173737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578098816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599771.173784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599771.173928:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098816 00000100:00100000:0.0:1787599771.173934:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098816 00000100:00100000:0.0:1787599771.173977:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787599771.173979:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599771.173986:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578098816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599771.174005:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599771.174049:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578098816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599771.174056:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599771.174108:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578098816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599771.174581:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578098944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599771.174635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599771.174971:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578098944 00000100:00100000:1.0:1787599771.174988:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578098944 00000100:00100000:1.0:1787599771.175033:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787599771.175042:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578098944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787599771.175068:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787599771.175274:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578098944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 232us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599771.175282:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787599771.175342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578098944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599772.005031:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599772.069603:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787599773.030091:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599774.056715:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599774.245054:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599774.247536:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578099072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787599774.247622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.247854:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099072 00000100:00100000:1.0:1787599774.247863:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099072 00000100:00100000:1.0:1787599774.247924:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787599774.247935:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578099072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599774.247965:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599774.248009:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578099072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599774.248016:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787599774.248037:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787599774.248160:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599774.248165:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599774.248168:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599774.248172:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1787599774.248176:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787599774.248181:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599774.248204:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433ae680 x1874433578099456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787599774.248238:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787599774.248241:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787599774.248243:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787599774.248246:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1787599774.248248:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787599774.248251:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:2.0:1787599774.248262:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2433afb80 x1874433578099968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787599774.248297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578099328:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.248327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.248355:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578100096:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.248391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.249520:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599774.249533:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578099584:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.249585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.249615:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578100224:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.249634:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.249665:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578099456:0@lo:8:kworker.0 00000100:00100000:2.0:1787599774.249693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.249711:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578099968:0@lo:8:kworker.0 00000100:00100000:2.0:1787599774.249747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.249779:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099328 00000100:00100000:2.0:1787599774.249786:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099328 00000100:00100000:2.0:1787599774.249839:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599774.249848:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578099328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.249895:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578099328:12345-0@lo:400:kworker.0 Request processed in 48us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.249902:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787599774.249926:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100096 00000100:00100000:2.0:1787599774.249930:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100096 00000100:00100000:2.0:1787599774.249960:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099584 00000100:00100000:2.0:1787599774.249963:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099584 00000100:00100000:2.0:1787599774.249974:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100224 00000100:00100000:2.0:1787599774.249976:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100224 00000100:00100000:2.0:1787599774.249997:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599774.250003:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578100096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250033:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578100096:12345-0@lo:400:kworker.0 Request processed in 30us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.250047:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599774.250059:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599774.250064:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578099584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250092:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578099584:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.250097:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787599774.250108:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599774.250114:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578100224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250136:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578100224:12345-0@lo:400:kworker.0 Request processed in 23us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.250142:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599774.250166:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099456 00000100:00100000:2.0:1787599774.250170:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099456 00000100:00100000:2.0:1787599774.250184:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099968 00000100:00100000:2.0:1787599774.250187:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099968 00000100:00100000:2.0:1787599774.250198:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599774.250204:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578099456:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787599774.250222:0:24165:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787599774.250254:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578099456:12345-0@lo:8:kworker.0 Request processed in 49us (559us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599774.250260:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787599774.250270:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599774.250275:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578099968:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787599774.250285:0:24165:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787599774.250318:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1874433578099968:12345-0@lo:8:kworker.0 Request processed in 41us (570us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787599774.250330:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787599774.250352:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599774.250365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578099712:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.250408:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578100352:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.250456:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787599774.250463:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578099200:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.250514:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578099840:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.250559:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099200 00000100:00100000:2.0:1787599774.250562:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099200 00000100:00100000:2.0:1787599774.250588:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787599774.250594:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578099200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250626:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578099200:12345-0@lo:400:kworker.0 Request processed in 32us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.250632:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787599774.250673:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599774.250678:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599774.250681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578099456:0@lo:8:kworker.0 00000100:00080000:2.0:1787599774.250689:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787599774.250692:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787599774.250695:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578099968:0@lo:8:kworker.0 00000100:00100000:2.0:1787599774.250715:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099712 00000100:00100000:2.0:1787599774.250723:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099712 00000100:00100000:2.0:1787599774.250744:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787599774.250749:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578099712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.250777:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578099712:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.250783:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787599774.251065:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100352 00000100:00100000:0.0:1787599774.251075:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100352 00000100:00100000:2.0:1787599774.251266:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578099840 00000100:00100000:2.0:1787599774.251270:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578099840 00000100:00100000:0.0:1787599774.251323:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787599774.251330:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578100352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599774.251367:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578100352:12345-0@lo:400:kworker.0 Request processed in 39us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.251374:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787599774.251462:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599774.251466:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599774.251597:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599774.251604:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578099840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.251638:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578099840:12345-0@lo:400:kworker.0 Request processed in 35us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.251644:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787599774.251730:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578099200:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.251743:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578099840:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.251984:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578099712:0@lo:400:kworker.0 00010000:00080000:2.0:1787599774.251996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2443e6300 x1874433578100352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599774.252006:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578100352:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.252047:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578099072:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787599774.252087:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2433af480 x1874433578099584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599774.252096:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578099584:0@lo:400:kworker.0 00010000:00080000:2.0:1787599774.252108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2443e4e00 x1874433578100224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599774.252120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578100224:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.252134:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578099328:0@lo:400:kworker.0 00010000:00080000:2.0:1787599774.252144:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2443e7480 x1874433578100096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599774.252151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578100096:0@lo:400:kworker.0 00000020:01000004:1.0:1787599774.382341:0:24983:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787599774.382345:0:24983:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787599774.382347:0:24983:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787599774.382469:0:24983:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96b2443de800 00000020:01000004:1.0:1787599774.382487:0:24983:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787599774.382502:0:24983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787599774.382517:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96b34dcf8000) 00000020:00000080:1.0:1787599774.382535:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787599774.443516:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787599774.451472:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787599774.452020:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787599774.452232:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787599774.454929:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787599774.455601:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787599774.456123:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1787599774.457273:0:24983:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787599774.457514:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787599774.457529:0:24983:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787599774.457540:0:24983:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929d102d 00000020:01000004:3.0:1787599774.457546:0:24983:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787599774.457567:0:24983:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.101@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787599774.457571:0:24983:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.101@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787599774.457577:0:24983:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787599774.457609:0:24983:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787599774.457613:0:24983:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.101@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787599774.490624:0:24983:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.101@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787599774.490663:0:24983:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.101@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787599774.490667:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787599774.490669:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599774.490670:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599774.490672:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599774.490673:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599774.490674:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599774.490676:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599774.490678:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599774.490679:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599774.490683:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787599774.490685:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599774.490686:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599774.490687:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599774.490688:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599774.490689:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599774.490690:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599774.490691:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599774.490692:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599774.490693:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787599774.490720:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787599774.490741:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787599774.493708:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.493938:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b347e22480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599774.497664:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100480 00000100:00100000:3.0:1787599774.497682:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100480 00000100:00100000:2.0:1787599774.497861:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787599774.497872:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24983:x1874433578100480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787599774.497910:0:22655:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787599774.497914:0:22655:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787599774.497917:0:22655:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787599774.498656:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24983:x1874433578100480:12345-0@lo:253:mount.lustre.0 Request processed in 782us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.498667:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787599774.498781:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243754380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787599774.498930:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787599774.498935:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787599774.498936:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787599774.498937:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787599774.498938:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787599774.498939:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787599774.498941:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787599774.498942:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787599774.498944:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787599774.498945:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787599774.498982:0:24983:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96b2443de800 from lustre-OST0001 10000000:01000000:1.0:1787599774.499009:0:24983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787599774.499011:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787599774.499019:0:24983:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96b345e08000 local copy 00010000:00010000:1.0:1787599774.499028:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.499119:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599774.499159:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.499195:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599774.499304:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100608 00000100:00100000:2.0:1787599774.499310:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100608 00000100:00100000:2.0:1787599774.499348:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787599774.499357:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24983:x1874433578100608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599774.499442:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24983:x1874433578100608:12345-0@lo:501:mount.lustre.0 Request processed in 76us (272us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787599774.499449:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787599774.499671:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100608:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787599774.499704:0:24983:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.101@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787599774.499721:0:24983:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.101@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787599774.499727:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.499737:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b24200dc00/0x5d2988b0929d0c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d0c67 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599774.499779:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96b2443de800 10000000:01000000:1.0:1787599774.499784:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787599774.500078:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787599774.500084:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787599774.500089:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787599774.500092:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787599774.500116:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.500125:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.500133:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.500147:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599774.500178:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.500212:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.500254:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100736 00000100:00100000:0.0:1787599774.500260:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100736 00000100:00100000:0.0:1787599774.500300:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787599774.500308:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:24983:x1874433578100736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599774.500328:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599774.500341:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3dc00/0x5d2988b0929d103b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d1034 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.500361:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3dc00/0x5d2988b0929d103b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d1034 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.500370:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3dc00/0x5d2988b0929d103b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d1034 expref: 22 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.500379:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3dc00, rc 0) 00000100:00100000:0.0:1787599774.500425:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578100736:12345-0@lo:101:mount.lustre.0 Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.500440:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787599774.500589:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599774.500613:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d103b expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.500629:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d103b expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599774.504623:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787599774.505941:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599774.508563:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787599774.508627:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787599774.508645:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787599774.508657:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787599774.508668:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787599774.508679:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787599774.508693:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787599774.508708:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787599774.508721:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787599774.508758:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787599774.508766:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787599774.508894:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599774.508969:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.509011:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.509173:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100864 00000100:00100000:0.0:1787599774.509182:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100864 00000100:00100000:0.0:1787599774.509238:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787599774.509247:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578100864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599774.509379:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578100864:12345-0@lo:501:mount.lustre.0 Request processed in 133us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.509384:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787599774.512613:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599774.512676:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599774.512770:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.512833:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1787599774.513055:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578100992 00000100:00100000:3.0:1787599774.513063:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578100992 00000100:00100000:3.0:1787599774.513126:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787599774.513143:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578100992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599774.514607:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578100992:12345-0@lo:503:mount.lustre.0 Request processed in 1450us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599774.514618:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787599774.514785:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578100992:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787599774.516850:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599774.516977:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599774.517075:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.517116:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b341254f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.517726:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101120 00000100:00100000:0.0:1787599774.517736:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101120 00000100:00100000:0.0:1787599774.517825:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787599774.517835:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578101120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599774.519071:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578101120:12345-0@lo:502:mount.lustre.0 Request processed in 1230us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.519097:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787599774.520010:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.520306:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787599774.520336:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787599774.520348:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787599774.520360:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787599774.520372:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787599774.520383:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787599774.520396:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787599774.520408:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787599774.520699:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1787599774.520742:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599774.521876:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.521930:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b352936480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.522063:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101248 00000100:00100000:0.0:1787599774.522071:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101248 00000100:00100000:0.0:1787599774.522132:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787599774.522141:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578101248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599774.522525:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578101248:12345-0@lo:502:mount.lustre.0 Request processed in 381us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.522534:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787599774.522761:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.522927:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1787599774.522940:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787599774.525577:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787599774.525588:0:24987:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787599774.525661:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787599774.525665:0:24987:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787599774.525737:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787599774.525755:0:24987:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96b34dcfcd28) 00000020:00000080:1.0:1787599774.525781:0:24987:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787599774.525788:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787599774.525946:0:24987:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b2443de800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787599774.526026:0:24987:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787599774.526034:0:24987:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d2988b0929d1049 00010000:00010000:1.0:1787599774.533939:0:24987:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787599774.534742:0:24987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1787599774.536475:0:24987:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787599774.540484:0:24987:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787599774.540500:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599774.540509:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599774.540511:0:24987:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787599774.540517:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599774.540522:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599774.540523:0:24987:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787599774.540527:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787599774.540529:0:24987:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787599774.540531:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599774.540533:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599774.540534:0:24987:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787599774.540536:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787599774.540539:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599774.540540:0:24987:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787599774.540542:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787599774.540574:0:24987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787599774.540578:0:24987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787599774.540580:0:24987:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787599774.540583:0:24987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787599774.544913:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787599774.545711:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787599774.545767:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d103b expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.545780:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54a800/0x5d2988b0929d1034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d103b expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599774.545848:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b2443de800 from 1 10000000:01000000:1.0:1787599774.545851:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599774.545889:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.545897:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.545931:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.545964:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787599774.546030:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.546068:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787599774.546959:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101376 00000100:00100000:2.0:1787599774.546968:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101376 00000100:00100000:2.0:1787599774.547019:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787599774.547042:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:24983:x1874433578101376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787599774.547055:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599774.547081:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d1050 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599774.547105:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599774.547116:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599774.547124:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6c600, rc 0) 00000100:00100000:2.0:1787599774.547176:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101376:12345-0@lo:101:mount.lustre.0 Request processed in 140us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.547183:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787599774.548257:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787599774.548280:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.548292:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787599774.554523:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787599774.555929:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787599774.557079:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787599774.557112:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787599774.557125:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787599774.557137:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787599774.557147:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787599774.557162:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787599774.557198:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787599774.557213:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787599774.557227:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787599774.557240:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787599774.557254:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787599774.557272:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787599774.557277:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787599774.557374:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599774.557453:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.557494:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.557719:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101504 00000100:00100000:0.0:1787599774.557727:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101504 00000100:00100000:0.0:1787599774.557809:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787599774.557819:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787599774.557932:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101504:12345-0@lo:501:mount.lustre.0 Request processed in 114us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.557940:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787599774.559454:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787599774.559510:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787599774.559574:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.559627:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351089300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.560096:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101632 00000100:00100000:0.0:1787599774.560103:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101632 00000100:00100000:0.0:1787599774.560151:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787599774.560160:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599774.560273:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101632:12345-0@lo:503:mount.lustre.0 Request processed in 114us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.560281:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787599774.561053:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787599774.563834:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787599774.563936:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599774.564132:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.564179:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787599774.564264:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101760 00000100:00100000:2.0:1787599774.564271:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101760 00000100:00100000:2.0:1787599774.564329:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787599774.564338:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787599774.564462:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101760:12345-0@lo:502:mount.lustre.0 Request processed in 125us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.564470:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787599774.564666:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.565248:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787599774.565365:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787599774.565386:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787599774.565402:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787599774.565417:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787599774.565441:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787599774.565457:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787599774.565494:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787599774.565511:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787599774.565523:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787599774.565534:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787599774.565564:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599774.565622:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.565658:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.565785:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578101888 00000100:00100000:0.0:1787599774.565811:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578101888 00000100:00100000:0.0:1787599774.565858:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787599774.565868:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599774.565984:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578101888:12345-0@lo:502:mount.lustre.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.565992:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787599774.566421:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578101888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.566484:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787599774.566494:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787599774.567463:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599774.567473:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.567476:0:24991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787599774.567483:0:24991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b2443de800 00000020:00000080:3.0:1787599774.567486:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599774.567493:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599774.567495:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.567497:0:24991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787599774.567499:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599774.567501:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.567503:0:24991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787599774.567506:0:24991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96b2443de800 00000020:00000080:3.0:1787599774.567508:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599774.567626:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599774.567630:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.567632:0:24991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787599774.567634:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599774.567637:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.567639:0:24991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599774.567642:0:24991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b2443de800 00000020:00000080:3.0:1787599774.567644:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599774.576765:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599774.578180:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.578188:0:24991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787599774.578198:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787599774.578204:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.578205:0:24991:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787599774.578211:0:24991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96b2443de800 00000020:00000080:3.0:1787599774.578214:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787599774.578301:0:24991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787599774.578305:0:24991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787599774.578307:0:24991:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787599774.578310:0:24991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787599774.580487:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787599774.580532:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599774.580558:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.580572:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599774.580743:0:24983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787599774.580748:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96b2443de800 10000000:01000000:0.0:1787599774.580751:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96b2443de800 10000000:01000000:0.0:1787599774.580755:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787599774.580762:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96b2443de800 from 1 10000000:01000000:0.0:1787599774.580765:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787599774.580821:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.580830:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.580842:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599774.580866:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787599774.580940:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599774.581406:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102016 00000100:00100000:0.0:1787599774.581414:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102016 00000100:00100000:0.0:1787599774.581478:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599774.581488:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:24983:x1874433578102016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599774.581504:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599774.581519:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3c600/0x5d2988b0929d1065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d105e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.581548:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3c600/0x5d2988b0929d1065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d105e expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.581574:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3c600/0x5d2988b0929d1065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d105e expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.581584:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c600, rc 0) 00000100:00100000:0.0:1787599774.583098:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102016:12345-0@lo:101:mount.lustre.0 Request processed in 1603us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.583109:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787599774.583173:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.583198:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787599774.583224:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1065 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.583236:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d1065 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599774.608936:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787599774.609319:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599774.609558:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787599774.609585:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787599774.610390:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787599774.610421:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787599774.610449:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787599774.610465:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787599774.610495:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787599774.610510:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787599774.610523:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787599774.610537:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787599774.610552:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787599774.610567:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787599774.610581:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787599774.610610:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787599774.610638:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787599774.610654:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787599774.610742:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787599774.610766:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787599774.610783:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787599774.610871:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787599774.610889:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787599774.610905:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787599774.610932:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787599774.611080:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787599774.611099:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787599774.611112:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787599774.611126:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787599774.611138:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787599774.611152:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787599774.611167:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787599774.611180:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787599774.611191:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787599774.611203:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787599774.611216:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787599774.611231:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787599774.611244:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787599774.611256:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787599774.611269:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787599774.611875:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787599774.611900:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787599774.611915:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787599774.611930:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787599774.611944:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787599774.612043:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787599774.612059:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787599774.612073:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787599774.612088:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787599774.612118:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787599774.612284:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787599774.614108:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787599774.614141:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787599774.614146:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787599774.614254:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599774.615995:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.616058:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599774.617592:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102144 00000100:00100000:2.0:1787599774.617618:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102144 00000100:00100000:2.0:1787599774.617678:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787599774.617689:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787599774.617886:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102144:12345-0@lo:501:mount.lustre.0 Request processed in 199us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.617904:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787599774.618923:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787599774.618997:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787599774.619059:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.619105:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.619207:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102272 00000100:00100000:0.0:1787599774.619214:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102272 00000100:00100000:0.0:1787599774.619254:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787599774.619263:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787599774.619368:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102272:12345-0@lo:503:mount.lustre.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.619376:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787599774.619458:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787599774.619918:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787599774.620184:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599774.620228:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.620286:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.622253:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102400 00000100:00100000:0.0:1787599774.622266:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102400 00000100:00100000:0.0:1787599774.622326:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787599774.622336:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599774.622624:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102400:12345-0@lo:502:mount.lustre.0 Request processed in 288us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.622634:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787599774.629212:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.629525:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787599774.629556:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787599774.629567:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787599774.629578:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787599774.629588:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787599774.630768:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787599774.630922:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787599774.630942:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787599774.631039:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787599774.631052:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787599774.631064:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787599774.631078:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787599774.631090:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787599774.631102:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787599774.631115:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787599774.631128:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787599774.631143:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787599774.631157:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787599774.631171:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787599774.631200:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787599774.631233:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787599774.631247:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787599774.631260:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787599774.631276:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787599774.631289:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787599774.631304:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787599774.631319:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787599774.631333:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787599774.631345:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787599774.631358:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787599774.631371:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787599774.631385:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787599774.631399:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787599774.631413:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787599774.631427:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787599774.631456:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787599774.631484:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787599774.631501:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787599774.631516:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787599774.631528:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787599774.631540:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787599774.631552:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787599774.631563:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787599774.631575:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787599774.631588:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787599774.632514:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787599774.632544:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787599774.632557:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787599774.633742:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599774.634095:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.634177:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787599774.639028:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102528 00000100:00100000:1.0:1787599774.639043:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102528 00000100:00100000:1.0:1787599774.639143:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787599774.639155:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787599774.639344:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102528:12345-0@lo:502:mount.lustre.0 Request processed in 191us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599774.639353:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787599774.639451:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.639692:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787599774.639718:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787599774.639761:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787599774.639835:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.642690:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.644963:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102656 00000100:00100000:0.0:1787599774.644976:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102656 00000100:00100000:0.0:1787599774.645026:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787599774.645037:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787599774.645209:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578102656:12345-0@lo:502:mount.lustre.0 Request processed in 173us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.645217:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787599774.645347:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578102656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787599774.645439:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787599774.645455:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787599774.647076:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787599774.647093:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96b242c3b370) 00000020:00000080:0.0:1787599774.647117:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787599774.647221:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b2443de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599774.647225:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b2443de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599774.647228:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b2443de800 3 00010000:00080000:0.0:1787599774.647257:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2441ea000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.101@tcp at head 00010000:00010000:0.0:1787599774.656077:0:24997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787599774.656338:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787599774.656387:0:24997:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787599774.656400:0:24997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d2988b0929d1073 00000100:00080000:0.0:1787599774.656410:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787599774.656416:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96b2441ea000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:0.0:1787599774.656849:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b243757480 x1874433578102784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787599774.656877:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787599774.657176:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578102784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599774.657260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599774.657377:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102784 00000100:00100000:0.0:1787599774.657392:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102784 00000100:00100000:0.0:1787599774.657428:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599774.657445:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1874433578102784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787599774.657468:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 721 last 0 00000020:00000080:0.0:1787599774.657519:0:22662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d2988b0929d107a 00000100:00080000:3.0:1787599774.657955:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599774.657960:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599774.657963:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599774.657968:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 720 00000100:00080000:3.0:1787599774.657971:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787599774.657976:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599774.657992:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b24347bb80 x1874433578103168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599774.658036:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787599774.658040:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787599774.658042:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787599774.658046:0:13886:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 720 00000100:00080000:3.0:1787599774.658048:0:13886:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787599774.658052:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599774.658062:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b243479c00 x1874433578103680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599774.658110:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578103424:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.658842:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578102912:0@lo:400:kworker.0 00000004:00100000:0.0:1787599774.661760:0:22662:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787599774.661850:0:22662:0:(import.c:65:import_set_state_nolock()) ffff96b2441e8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599774.661943:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1874433578102784:12345-0@lo:38:llog_process_th.0 Request processed in 4494us (4680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.662257:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:0.0:1787599774.662414:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787599774.662439:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff96b242c38000) 00000020:00000080:0.0:1787599774.662464:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787599774.663138:0:24997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96b2443de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599774.663199:0:24997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96b2443de800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787599774.663202:0:24997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96b2443de800 3 00010000:00080000:0.0:1787599774.663234:0:24997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96b2441e9000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.101@tcp at head 00000100:00100000:3.0:1787599774.663739:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.663804:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578104064:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.663848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.663897:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578103296:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.663919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.663937:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578103936:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.664033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.664057:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787599774.664064:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578103040:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.664088:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.664108:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578103808:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.664128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.664678:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578103168:0@lo:8:kworker.0 00000100:00100000:3.0:1787599774.664710:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.664730:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578103680:0@lo:8:kworker.0 00000100:00100000:3.0:1787599774.664751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.665711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599774.665747:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578103552:0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.665826:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103424 00000100:00100000:2.0:1787599774.665835:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103424 00000100:00100000:2.0:1787599774.665880:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578102912 00000100:00100000:2.0:1787599774.665883:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578102912 00000100:00100000:2.0:1787599774.665898:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599774.665907:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.665985:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578103424:12345-0@lo:400:kworker.0 Request processed in 78us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.665992:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787599774.666008:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599774.666014:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578102912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.666042:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578102912:12345-0@lo:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.666048:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787599774.668087:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104064 00000100:00100000:2.0:1787599774.668102:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104064 00000100:00100000:2.0:1787599774.668146:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103296 00000100:00100000:2.0:1787599774.668150:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103296 00000100:00100000:2.0:1787599774.668163:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103936 00000100:00100000:2.0:1787599774.668165:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103936 00000100:00100000:2.0:1787599774.668187:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103808 00000100:00100000:2.0:1787599774.668190:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103808 00000100:00100000:2.0:1787599774.668207:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787599774.668216:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.668310:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578104064:12345-0@lo:400:kworker.0 Request processed in 94us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.668317:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787599774.668333:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599774.668340:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578103296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.668388:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874433578103296:12345-0@lo:400:kworker.0 Request processed in 49us (4467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.668394:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787599774.668406:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599774.668412:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578103936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.668452:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874433578103936:12345-0@lo:400:kworker.0 Request processed in 40us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.668458:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787599774.668469:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787599774.668476:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578103808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599774.669749:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578103808:12345-0@lo:400:kworker.0 Request processed in 1266us (5612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599774.669761:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787599774.670739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347b800 x1874433578103808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.670756:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578103808:0@lo:400:kworker.0 00010000:00080000:3.0:1787599774.670770:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243478000 x1874433578103296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.670778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874433578103296:0@lo:400:kworker.0 00010000:00080000:3.0:1787599774.670821:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b24347b480 x1874433578103936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.670830:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1874433578103936:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.670874:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103040 00000100:00100000:3.0:1787599774.670881:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103040 00000100:00100000:3.0:1787599774.670931:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103168 00000100:00100000:3.0:1787599774.670935:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103168 00000100:00100000:3.0:1787599774.670956:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103680 00000100:00100000:3.0:1787599774.670959:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103680 00000100:00100000:3.0:1787599774.670971:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599774.670979:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671039:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578103040:12345-0@lo:400:kworker.0 Request processed in 61us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599774.671046:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787599774.671060:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599774.671064:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578103168:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787599774.671112:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578103168:12345-0@lo:8:kworker.0 Request processed in 46us (6401us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787599774.671118:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787599774.671129:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599774.671133:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578103680:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787599774.671163:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578103680:12345-0@lo:8:kworker.0 Request processed in 28us (6411us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787599774.671168:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787599774.671219:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578103040:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671249:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578103424:0@lo:400:kworker.0 00010000:00080000:3.0:1787599774.671273:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440efb80 x1874433578104064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.671282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578104064:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.671344:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578102912:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671361:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578103552 00000100:00100000:3.0:1787599774.671364:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578103552 00000100:00100000:3.0:1787599774.671385:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599774.671391:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578103552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671426:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578103552:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599774.671441:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787599774.671466:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578103552:0@lo:400:kworker.0 00000100:00100000:3.0:1787599774.671502:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599774.671510:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599774.671515:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787599774.671518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578103680:0@lo:8:kworker.0 00010000:00080000:3.0:1787599774.671537:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b243757480 x1874433578102784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.671544:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599774.671550:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787599774.671557:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787599774.671562:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787599774.671565:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2441ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599774.671579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1874433578102784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787599774.671617:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599774.671621:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787599774.671624:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787599774.671627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578103168:0@lo:8:kworker.0 00010000:00010000:3.0:1787599774.676152:0:24997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1787599774.689819:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787599774.689875:0:24997:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787599774.689889:0:24997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5d2988b0929d1088 00000100:00080000:3.0:1787599774.689902:0:24997:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787599774.689908:0:24997:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96b2441e9000 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:3.0:1787599774.689945:0:24997:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b2440eca80 x1874433578104192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787599774.690372:0:24997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787599774.690675:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578104192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787599774.690757:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599774.691717:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104192 00000100:00100000:3.0:1787599774.691728:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104192 00000100:00100000:3.0:1787599774.691767:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787599774.691775:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1874433578104192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787599774.691826:0:22659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 721 last 0 00000020:00000080:3.0:1787599774.691861:0:22659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5d2988b0929d108f 00000004:00100000:3.0:1787599774.691876:0:22659:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787599774.691908:0:22659:0:(import.c:65:import_set_state_nolock()) ffff96b24444c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599774.693114:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1874433578104192:12345-0@lo:38:llog_process_th.0 Request processed in 1330us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599774.693127:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787599774.693232:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96b2440eca80 x1874433578104192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787599784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599774.693244:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787599774.693255:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787599774.693264:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787599774.693269:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787599774.693272:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b2441e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787599774.693280:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1874433578104192:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787599774.695338:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787599774.695741:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787599774.695782:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787599774.696022:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1065 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.696037:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36ef3cc00/0x5d2988b0929d105e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1065 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787599774.696098:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787599774.696101:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599774.696102:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599774.696103:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599774.696109:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599774.696110:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599774.696112:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599774.696114:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599774.696115:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599774.696118:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787599774.696120:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787599774.696122:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787599774.696123:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787599774.696124:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787599774.696125:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787599774.696126:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787599774.696127:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787599774.696128:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787599774.696129:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787599774.696158:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787599774.696177:0:24983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578104320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787599774.696250:0:24983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599774.696299:0:24983:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b358ee0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787599774.696419:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104320 00000100:00100000:1.0:1787599774.696427:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104320 00000100:00100000:1.0:1787599774.696532:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787599774.696542:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578104320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787599774.696568:0:22655:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787599774.696582:0:22655:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787599774.702292:0:22655:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787599774.702336:0:22655:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787599774.702703:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:24983:x1874433578104320:12345-0@lo:253:mount.lustre.0 Request processed in 6156us (6446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.702716:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787599774.703031:0:24983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:559ac968-b0ab-4af8-8146-7f269e4a29a3:24983:1874433578104320:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787599774.703049:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787599774.703052:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787599774.703053:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787599774.703055:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787599774.703056:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787599774.703057:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787599774.703058:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787599774.703060:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787599774.703062:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787599774.703064:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787599774.703094:0:24983:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787599774.708266:0:22676:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787599774.708274:0:22676:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787599774.708297:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708315:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708323:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708331:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708373:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708392:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 23 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.708406:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578104448:0@lo:104: 00000100:00100000:1.0:1787599774.708616:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787599774.708671:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.708679:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 23 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.708701:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578104576:0@lo:104: 00000100:00100000:1.0:1787599774.708724:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599774.708740:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b351453f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787599774.708877:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104448 00000100:00100000:0.0:1787599774.708885:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104448 00000100:00100000:0.0:1787599774.708919:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104576 00000100:00100000:0.0:1787599774.708922:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104576 00000100:00100000:0.0:1787599774.708936:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599774.708955:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578104448:12345-0@lo:104: 00010000:00010000:0.0:1787599774.708969:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709033:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599774.709047:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:22676:x1874433578104448:12345-0@lo:104: Request processed in 102us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.709053:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599774.709070:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599774.709076:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578104576:12345-0@lo:104: 00010000:00010000:0.0:1787599774.709083:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709116:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599774.709122:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:22676:x1874433578104576:12345-0@lo:104: Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.709128:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787599774.709148:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599774.709285:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709292:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6600 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599774.709297:0:24192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709306:0:24192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599774.709313:0:24192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599774.709319:0:24192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599774.709349:0:24192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709365:0:24192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599774.709384:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709391:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6600/0x5d2988b0929d0f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f31 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709403:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599774.709406:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709411:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6e00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:0.0:1787599774.709414:0:24192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709419:0:24192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787599774.709426:0:24192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787599774.709443:0:24192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787599774.709457:0:24192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709464:0:24192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787599774.709478:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709484:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b3778b6e00/0x5d2988b0929d0f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0f23 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709579:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599774.709581:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599774.709582:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599774.709589:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599774.709607:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787599774.709620:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578104704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599774.709652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599774.709689:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578104832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787599774.709710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599774.709745:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104704 00000100:00100000:0.0:1787599774.709749:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104704 00010000:00010000:0.0:1787599774.709767:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 24 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599774.709787:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104832 00000100:00100000:0.0:1787599774.709821:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104832 00010000:00010000:0.0:1787599774.709833:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 25 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599774.709846:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599774.709852:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+25:3647:x1874433578104704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599774.709862:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599774.709867:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 25 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709877:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 25 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.709904:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599774.709933:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+25:3647:x1874433578104704:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.709940:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787599774.710364:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599774.710372:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578104832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599774.710380:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599774.710386:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 24 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710395:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 24 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710476:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710641:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787599774.710657:0:22645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013577406s 00010000:00010000:0.0:1787599774.710662:0:22645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710668:0:22645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710675:0:22645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710693:0:22645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710698:0:22645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ae00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599774.710702:0:22645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710708:0:22645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710716:0:22645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599774.710725:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599774.710773:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578104832:12345-0@lo:103:ldlm_bl.0 Request processed in 402us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599774.710780:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599774.710845:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578104704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599774.711090:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b6400/0x5d2988b0929d0f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0f2a expref: 23 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.711103:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578104448:0@lo:104: 00010000:00010000:1.0:1787599774.711114:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d0f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0f1c expref: 22 pid: 22655 timeout: 821 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599774.711121:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22676:1874433578104576:0@lo:104: 00010000:00010000:1.0:1787599774.711135:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.711142:0:22676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.711148:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599774.711167:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b37b54ae00/0x5d2988b0929d1096 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599774.711423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578104832:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1787599774.714467:0:24983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787599774.721137:0:24983:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787599774.721158:0:24983:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787599774.721198:0:24983:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787599774.721248:0:24983:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.101@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787599774.721282:0:24983:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787599774.721304:0:24983:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787599774.727287:0:24983:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787599774.728912:0:24983:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787599775.077498:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599775.527011:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787599776.053053:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599776.053062:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b37f896800 from 14 10000000:01000000:1.0:1787599776.053069:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599776.053121:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.053133:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.053145:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599776.053173:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578104960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599776.053246:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599776.053295:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599776.053544:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578104960 00000100:00100000:0.0:1787599776.053554:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578104960 00000100:00100000:0.0:1787599776.053746:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787599776.053757:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578104960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599776.053771:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599776.053785:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d800/0x5d2988b0929d10a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d109d expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599776.053824:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d800/0x5d2988b0929d10a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d109d expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599776.053851:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3d800/0x5d2988b0929d10a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d109d expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599776.053860:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d800, rc 0) 00000100:00100000:0.0:1787599776.053903:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578104960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599776.053910:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787599776.058890:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578104960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599776.058923:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10a4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.058948:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d10a4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599776.059027:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599776.059096:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599776.059143:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599776.059162:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105088 00000100:00100000:1.0:1787599776.059168:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105088 00000100:00100000:1.0:1787599776.059211:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787599776.059219:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578105088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599776.059237:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599776.059257:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599776.059260:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787599776.059341:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578105088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599776.059349:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787599776.059388:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787599776.059452:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599776.059459:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10a4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059468:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54b200/0x5d2988b0929d109d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10a4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787599776.059478:0:22657:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787599776.059481:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96b344b34800 from 14 10000000:01000000:1.0:1787599776.059484:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787599776.059521:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059529:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059538:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599776.059557:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599776.059598:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599776.059613:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599776.059625:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105216 00000100:00100000:1.0:1787599776.059628:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105216 00000100:00100000:1.0:1787599776.059651:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787599776.059657:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578105216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599776.059666:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599776.059679:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d10b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d10ab expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059696:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d10ab expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059706:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54ba00/0x5d2988b0929d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d10ab expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059714:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ba00, rc 0) 00000100:00100000:1.0:1787599776.059740:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578105216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599776.059746:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787599776.059778:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599776.059788:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10b2 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.059826:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d10b2 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599776.059871:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787599776.059900:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599776.059913:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599776.059925:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105344 00000100:00100000:1.0:1787599776.059928:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105344 00000100:00100000:1.0:1787599776.059948:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787599776.059955:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578105344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787599776.059965:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787599776.059975:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787599776.059978:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787599776.060036:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578105344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599776.060043:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787599776.060073:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578105344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787599776.060109:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787599776.060114:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10b2 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599776.060121:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b37b54a200/0x5d2988b0929d10ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d10b2 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599776.101120:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599776.306963:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787599776.306988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578105472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599776.307058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599776.307112:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105472 00000100:00100000:3.0:1787599776.307119:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105472 00000100:00100000:3.0:1787599776.307175:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599776.307187:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578105472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599776.307229:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599776.307276:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578105472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599776.307283:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787599776.307306:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599776.307340:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578105472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599776.310120:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599776.310143:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578105600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599776.310209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599776.310558:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105600 00000100:00100000:2.0:1787599776.310566:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105600 00000100:00100000:2.0:1787599776.310640:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787599776.310650:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578105600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599776.310682:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599776.310737:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578105600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599776.310745:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599776.310896:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578105600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599776.319892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599776.319916:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578105728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599776.319987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599776.320040:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105728 00000100:00100000:3.0:1787599776.320047:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105728 00000100:00100000:3.0:1787599776.320094:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599776.320104:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578105728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599776.320143:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599776.320193:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578105728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599776.320200:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787599776.320250:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578105728:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787599776.341725:0:25052:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787599776.342003:0:25052:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787599777.125072:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599778.156832:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.185021:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599779.365587:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578105856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599779.365672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.366661:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105856 00000100:00100000:3.0:1787599779.366673:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105856 00000100:00080000:0.0:1787599779.366744:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599779.366763:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599779.366777:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578105856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599779.367531:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599779.367718:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578105856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 943us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.367729:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787599779.368447:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578105856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787599779.877058:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599779.877067:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599779.877072:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599779.877099:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96b24442c800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599779.877124:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b34e5c0700 x1874433578106368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787599779.877161:0:13886:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787599779.877164:0:13886:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787599779.877166:0:13886:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787599779.877170:0:13886:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96b3707a5800 using connection 192.168.202.101@tcp/0@lo 00000100:00100000:1.0:1787599779.877181:0:13886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96b377b0df80 x1874433578106880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787599779.877422:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578106496:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.877545:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578107136:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.877600:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787599779.877607:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578105984:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.877669:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578106624:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.877713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578107264:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.877763:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578106112:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.877786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.878556:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578105984 00000100:00100000:1.0:1787599779.878567:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578105984 00000100:00100000:1.0:1787599779.878631:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787599779.878642:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578105984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599779.879927:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578106240:0@lo:400:kworker.0 00000100:00100000:1.0:1787599779.883956:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578105984:12345-0@lo:400:kworker.0 Request processed in 5303us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.883972:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787599779.884043:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106496 00000100:00100000:1.0:1787599779.884052:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106496 00000100:00100000:1.0:1787599779.884099:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107136 00000100:00100000:1.0:1787599779.884103:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107136 00000100:00100000:1.0:1787599779.884129:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107264 00000100:00100000:1.0:1787599779.884132:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107264 00000100:00100000:1.0:1787599779.884151:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599779.884160:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578106496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599779.884219:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578106496:12345-0@lo:400:kworker.0 Request processed in 61us (6713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.884353:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599779.884718:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578107136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.884765:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578107136:12345-0@lo:400:kworker.0 Request processed in 404us (7193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.884772:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787599779.884810:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599779.884829:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578107264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.884862:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578107264:12345-0@lo:400:kworker.0 Request processed in 35us (7127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.884869:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787599779.884956:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106624 00000100:00100000:3.0:1787599779.884961:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106624 00000100:00100000:3.0:1787599779.884985:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106112 00000100:00100000:3.0:1787599779.884988:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106112 00000100:00100000:3.0:1787599779.885000:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599779.885007:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578106624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.885043:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578106624:12345-0@lo:400:kworker.0 Request processed in 35us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.885049:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787599779.885061:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599779.885068:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578106112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.885096:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578106112:12345-0@lo:400:kworker.0 Request processed in 29us (7309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.885101:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787599779.885144:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578106112:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.885158:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578106752:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.885193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.885223:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106752 00000100:00100000:3.0:1787599779.885227:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106752 00000100:00100000:1.0:1787599779.885543:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787599779.885574:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578106368:0@lo:8:kworker.0 00000100:00100000:1.0:1787599779.885603:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.885625:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578106880:0@lo:8:kworker.0 00000100:00100000:1.0:1787599779.885645:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787599779.885684:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599779.885690:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599779.885702:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106368 00000100:00100000:1.0:1787599779.885706:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106368 00000100:00100000:1.0:1787599779.885724:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106880 00000100:00100000:1.0:1787599779.885727:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106880 00000100:00100000:1.0:1787599779.885736:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599779.885741:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578106368:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787599779.885773:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:1.0:1787599779.885822:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d2988b0929d10b9 00002000:00100000:1.0:1787599779.885838:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96b242ce2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787599779.885842:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787599779.885846:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599779.886027:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599779.886052:0:24167:0:(import.c:65:import_set_state_nolock()) ffff96b242ce7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599779.886093:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1874433578106368:12345-0@lo:8:kworker.0 Request processed in 351us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.886100:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599779.886114:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787599779.886118:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1874433578106880:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787599779.886131:0:24167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:1.0:1787599779.886147:0:24167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5d2988b0929d10c0 00002000:00100000:1.0:1787599779.886153:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff96b242ce0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787599779.886183:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787599779.886184:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787599779.886205:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787599779.886217:0:24167:0:(import.c:65:import_set_state_nolock()) ffff96b242ce5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599779.886598:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599779.886604:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578106752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.886642:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578106752:12345-0@lo:400:kworker.0 Request processed in 38us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.886655:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787599779.886693:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578106752:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.886702:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578107392:0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.886731:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599779.886755:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107392 00000100:00100000:3.0:1787599779.886759:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107392 00000100:00100000:3.0:1787599779.886786:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787599779.886810:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578107392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.886841:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874433578107392:12345-0@lo:400:kworker.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.886847:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787599779.886875:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1180 x1874433578107392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599779.886885:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1874433578107392:0@lo:400:kworker.0 00000100:00100000:2.0:1787599779.887151:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599779.887175:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578107008:0@lo:400:kworker.0 00000100:00100000:2.0:1787599779.887197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599779.887217:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578107520:0@lo:400:kworker.0 00000100:00100000:2.0:1787599779.887237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.888374:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1874433578106880:12345-0@lo:8:kworker.0 Request processed in 2249us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.888395:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787599779.888439:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599779.888559:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578106240 00000100:00100000:3.0:1787599779.888569:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578106240 00000100:00100000:3.0:1787599779.888618:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599779.888628:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578106240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.888686:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578106240:12345-0@lo:400:kworker.0 Request processed in 60us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.888692:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787599779.888713:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107008 00000100:00100000:3.0:1787599779.888717:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107008 00000100:00100000:3.0:1787599779.888740:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107520 00000100:00100000:3.0:1787599779.888743:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107520 00000100:00100000:3.0:1787599779.888776:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599779.888781:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578107008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.888835:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874433578107008:12345-0@lo:400:kworker.0 Request processed in 53us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.888840:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787599779.888851:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599779.888858:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578107520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599779.888886:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874433578107520:12345-0@lo:400:kworker.0 Request processed in 29us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599779.888892:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787599779.888939:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578106240:0@lo:400:kworker.0 00010000:00080000:3.0:1787599779.888954:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b351769180 x1874433578107008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599779.888965:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b351769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874433578107008:0@lo:400:kworker.0 00010000:00080000:3.0:1787599779.888977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e2300 x1874433578107520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599779.888987:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1874433578107520:0@lo:400:kworker.0 00000100:00080000:1.0:1787599779.889087:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599779.889090:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787599779.891005:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b34e5c0700 x1874433578106368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599779.891030:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787599779.891042:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599779.891050:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787599779.891056:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b24442c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599779.891090:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599779.891098:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1874433578106368:0@lo:8:kworker.0 00010000:00080000:1.0:1787599779.891115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b0df80 x1874433578106880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787599804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787599779.891124:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787599779.891128:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787599779.891131:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787599779.891133:0:3644:0:(import.c:65:import_set_state_nolock()) ffff96b3707a5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787599779.891152:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787599779.891156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1874433578106880:0@lo:8:kworker.0 00000004:00080000:1.0:1787599779.891359:0:23406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787599779.891407:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578107904:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.891471:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.891500:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1840 going to sleep for 11 seconds 00000004:00080000:1.0:1787599779.891518:0:23405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787599779.891617:0:23405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 726510823650ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787599779.891625:0:23405:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787599779.891653:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107904 00000100:00100000:1.0:1787599779.891659:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107904 00000100:00100000:1.0:1787599779.891710:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599779.891720:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1874433578107904:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.892081:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578107776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599779.892114:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787599779.892184:0:22686:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787599779.892248:0:22686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726511455368ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787599779.892253:0:22686:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787599779.895182:0:22687:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787599779.895257:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874433578108032:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787599779.895330:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599779.895377:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34559ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599779.895518:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108032 00000100:00100000:3.0:1787599779.895527:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108032 00000100:00100000:3.0:1787599779.895585:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787599779.895597:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22687:x1874433578108032:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787599779.899668:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787599779.899692:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578107648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.899779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.899857:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107776 00000100:00100000:1.0:1787599779.899866:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107776 00000100:00100000:1.0:1787599779.899909:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578107648 00000100:00100000:1.0:1787599779.899912:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578107648 00000100:00100000:1.0:1787599779.899930:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599779.899939:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433578107776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599779.899977:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599779.900024:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1874433578107776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (7908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.900031:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787599779.900049:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787599779.900055:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874433578107648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599779.900075:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599779.900097:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1874433578107648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.900102:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787599779.900280:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787599779.900502:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0e00 x1874433578107648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.900522:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578107648:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787599779.900535:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e5500 x1874433578107776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.900565:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578107776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599779.900642:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578105984:0@lo:400:kworker.0 00000100:00100000:1.0:1787599779.900655:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578106624:0@lo:400:kworker.0 00010000:00080000:1.0:1787599779.900667:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1c00 x1874433578107264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.900675:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578107264:0@lo:400:kworker.0 00010000:00080000:1.0:1787599779.900685:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b377b0d180 x1874433578106496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.900692:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578106496:0@lo:400:kworker.0 00010000:00080000:1.0:1787599779.900702:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e0a80 x1874433578107136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.900709:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578107136:0@lo:400:kworker.0 00000004:00080000:1.0:1787599779.901567:0:23395:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787599779.909788:0:24168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787599779.909845:0:24168:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787599779.909952:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1874433578107904:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18228us (18476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.909964:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787599779.910025:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1f80 x1874433578107904/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787599795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.910042:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578107904:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787599779.910062:0:23406:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787599779.910111:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578108160:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.910146:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.910173:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599779.910193:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108160 00000100:00100000:1.0:1787599779.910200:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108160 00000100:00100000:1.0:1787599779.910326:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787599779.910337:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23406:x1874433578108160:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787599779.910367:0:24501:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787599779.910412:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23406:x1874433578108160:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599779.910418:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787599779.910443:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1f80 x1874433578108160/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787599795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.910452:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578108160:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787599779.910461:0:23406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787599779.910497:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578108288:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.910520:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.910538:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37060b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599779.910610:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108288 00000100:00100000:1.0:1787599779.910615:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108288 00000100:00100000:1.0:1787599779.910641:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599779.910647:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1874433578108288:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787599779.910676:0:24168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:2.0:1787599779.912366:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787599779.913540:0:24165:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787599779.913565:0:24165:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787599779.913571:0:24165:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:3.0:1787599779.934447:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.934462:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.934482:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.934487:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.934495:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.934514:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.934524:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.934531:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.935751:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599779.936339:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599779.936350:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.936363:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599779.936368:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.936379:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.936425:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.936433:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeedcaad/0x5d2988b0929d10c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.936469:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.936471:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.936473:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.937034:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.937043:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.937054:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.937059:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.937064:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.937083:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.937093:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.937101:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.937123:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.937450:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.937458:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.937467:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758c00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.937471:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.937480:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.937496:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.937504:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9fafba/0x5d2988b0929d10ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.937533:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.938518:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.938528:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.939364:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.939378:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.939409:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.939414:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.939421:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.939435:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.939445:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.939470:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.939494:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.940062:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.940070:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.940081:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.940086:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.940094:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.940114:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.940121:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f69917b0/0x5d2988b0929d10d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.940157:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.940159:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.940160:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.943187:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.943203:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.943459:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.943465:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.943474:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.943491:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.943502:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.943509:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.943537:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599779.943874:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599779.943883:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.943893:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599779.943898:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.943907:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.943925:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.943933:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059b72e95/0x5d2988b0929d10dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.943985:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.943987:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.943988:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.945530:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.945555:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.945576:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.945581:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.945587:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.945600:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.945609:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.945617:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.945646:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599779.945940:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599779.945947:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.945956:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599779.945961:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.945970:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.945985:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.945993:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678a7345/0x5d2988b0929d10e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.946026:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.946028:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.946030:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.947771:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.947786:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.947821:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.947826:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.947832:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.947845:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.947870:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.947877:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.947896:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.949194:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.949206:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.949220:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.949237:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.949259:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.949280:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.949288:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4561af7/0x5d2988b0929d10ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.949330:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.949332:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.949335:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599779.949722:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.949731:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.949741:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.949746:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.949752:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.949763:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.949771:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.949779:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.949839:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599779.952924:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599779.952942:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.952958:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599779.952963:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599779.952970:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.952985:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.952995:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.953003:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599779.953027:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787599779.953569:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599779.953577:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953588:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.953593:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953602:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953620:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953641:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d6c1053/0x5d2988b0929d10f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953663:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.953667:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953674:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.953678:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953685:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953696:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953703:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d10f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.953717:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.953719:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.953721:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599779.955774:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599779.955831:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955867:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1787599779.955872:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599779.955879:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955892:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955902:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955910:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955927:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.955938:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.955943:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955951:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54bc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.955955:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955964:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955990:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.955997:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027503b56/0x5d2988b0929d10ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.956016:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.956018:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.956020:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787599779.956711:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599779.956720:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.957044:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1787599779.957049:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599779.957055:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.957066:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.957075:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.957082:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.957148:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787599779.963437:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787599779.963454:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.963473:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1787599779.963478:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599779.963485:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.963501:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.963511:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.963519:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964220:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599779.964242:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964252:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599779.964257:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964267:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964300:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964308:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9793835/0x5d2988b0929d1106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964332:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599779.964336:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964342:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54ae00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599779.964345:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964353:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964363:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.964370:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599779.964372:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599779.964374:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.964525:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.978675:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787599779.978692:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028b46770/0x5d2988b0929d110d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.980083:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787599779.980343:0:24984:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787599779.980366:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787599779.980395:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787599779.980687:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23406:x1874433578108288:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70033us (70159us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787599779.980708:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599779.980888:0:23406:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787599779.980899:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1874433578108288:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787599779.980915:0:23406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787599779.980964:0:23406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23406:1874433578108416:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787599779.981001:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599779.981024:0:23406:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3440a59c0 going to sleep for 11 seconds 00002000:00010000:0.0:1787599779.981164:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599779.981179:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.981195:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1787599779.981200:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599779.981206:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.981220:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.981243:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.981251:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.981274:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599779.981832:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108416 00000100:00100000:2.0:1787599779.981839:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108416 00000100:00100000:2.0:1787599779.981889:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787599779.981899:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23406:x1874433578108416:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787599779.981962:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23406:x1874433578108416:12345-0@lo:900:osp-pre-1-1.0 Request processed in 64us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599779.981969:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1787599779.982370:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.982377:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.982401:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.982404:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.982409:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.982421:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.982429:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.982437:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.982472:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787599779.982652:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599779.982659:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982667:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.982671:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982680:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982696:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982702:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc4623cf/0x5d2988b0929d1114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982721:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.982724:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982737:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.982740:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982747:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982757:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982763:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f087859f/0x5d2988b0929d111b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.982775:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.982776:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.982778:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787599779.982830:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433e1f80 x1874433578108416/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787599795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599779.982841:0:23406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23406:1874433578108416:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1787599779.982912:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.986785:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.986828:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.986847:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.986851:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.986858:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.986871:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.986881:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.986889:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.986914:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.991105:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.991127:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.991145:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.991173:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.991185:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.991211:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.991232:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f37f568c/0x5d2988b0929d1122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.991267:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.991270:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.991272:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.991655:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.991665:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.991677:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.991688:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.991694:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.991705:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.991714:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.991721:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.991745:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.992188:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.992195:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.992203:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6cc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.992207:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.992215:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.992240:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.992255:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a28c6b8/0x5d2988b0929d1129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.992273:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.992275:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.992277:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.993170:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.993184:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.993197:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.993201:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.993207:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.993220:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.993245:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.993267:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.993295:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599779.993744:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599779.993753:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.993761:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ce00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599779.993766:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.993786:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.993835:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.993842:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a47de9da/0x5d2988b0929d1130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599779.993862:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.993863:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599779.993865:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.994007:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.994015:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994023:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.994027:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.994031:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994040:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994047:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994054:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994075:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.994330:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.994336:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994345:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.994348:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994356:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994369:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994375:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c56523/0x5d2988b0929d1137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994402:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.994404:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.994406:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.994540:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.994554:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994569:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.994573:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.994578:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994588:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994596:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994604:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.994623:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599779.994917:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599779.994923:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994931:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6de00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599779.994934:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994942:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994953:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994961:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0945eed/0x5d2988b0929d113e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599779.994977:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.994978:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599779.994980:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599779.995171:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599779.995178:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.995186:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599779.995190:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599779.995194:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.995204:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.995391:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.995400:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599779.995452:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599780.001943:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599780.001962:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.001983:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599780.002005:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599780.002013:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.002028:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.002039:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.002047:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.002170:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599780.002179:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.002188:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599780.002193:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.002203:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.002233:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.002253:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abf95709/0x5d2988b0929d1145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.002490:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787599780.008863:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599780.008880:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.008896:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599780.008901:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599780.008908:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.008922:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.008933:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.008957:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.009060:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599780.009068:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.009077:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759a00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599780.009081:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.009103:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.009120:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.009126:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cfe490/0x5d2988b0929d114c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009244:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599780.009249:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009257:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599780.009260:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009268:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009278:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009286:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.009287:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.009289:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599780.009428:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787599780.009434:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f4ac6d/0x5d2988b0929d1153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.009612:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787599780.009943:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787599780.009950:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.009960:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=726s v=(0 0) 00010000:00010000:3.0:1787599780.009963:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599780.009968:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.009977:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.009984:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.009992:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010096:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787599780.010177:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599780.010183:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010191:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599780.010194:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010203:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010214:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010221:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fd84664/0x5d2988b0929d115a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.010252:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599780.010253:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.015658:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599780.016276:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599780.016289:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016320:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1787599780.016325:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599780.016332:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016345:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016355:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016363:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016381:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599780.016405:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599780.016410:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016418:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599780.016423:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016431:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016459:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016465:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001041c48f/0x5d2988b0929d1161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.016485:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.016487:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.016489:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599780.017116:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599780.017319:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599780.017327:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017339:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1787599780.017342:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599780.017347:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017358:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017366:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017374:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017413:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787599780.017422:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787599780.017427:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017435:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599780.017439:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017447:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017461:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017468:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c58cd26/0x5d2988b0929d1168 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.017484:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.017486:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599780.017487:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787599780.019973:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787599780.019987:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.020002:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=726s v=(0 0) 00010000:00010000:0.0:1787599780.020015:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599780.020021:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.020033:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.020043:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.020050:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.020068:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787599780.020292:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599780.020300:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.020309:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599780.020314:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.020324:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.020340:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.020349:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000917082b/0x5d2988b0929d116f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.020369:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599780.020377:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599780.020378:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599780.026889:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.026905:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.026923:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.026927:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.026933:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.026946:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.026956:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.026964:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.026986:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787599780.027457:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599780.027465:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.027475:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599780.027480:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.027489:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.027506:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.027514:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd97845c/0x5d2988b0929d1176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.027542:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.027543:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.027545:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599780.027718:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.027725:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.027734:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.027737:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.027741:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.027759:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.027767:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.027774:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.027866:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787599780.028234:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.028241:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.028250:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.028253:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.028257:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.028267:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.028275:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.028292:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028380:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787599780.028395:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028403:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6da00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599780.028407:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028415:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028427:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028434:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9d6777f/0x5d2988b0929d117d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028448:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599780.028451:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028458:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599780.028467:0:24192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028475:0:24192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028484:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.028491:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.028493:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.028494:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599780.035908:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787599780.035922:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de0ffd2b/0x5d2988b0929d1184 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.036631:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787599780.037457:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.037469:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.037486:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.037491:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.037498:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.037513:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.037524:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.037533:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.037825:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787599780.038493:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.038503:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.038515:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.038519:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.038524:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.038535:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.038545:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.038562:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.043360:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787599780.043374:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.043400:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6dc00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:0.0:1787599780.043407:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.043418:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.043442:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599780.043464:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f049f43/0x5d2988b0929d118b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.044106:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787599780.044116:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.044125:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d000 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599780.044129:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.044136:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.044148:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599780.044158:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.044166:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787599780.044169:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599780.045429:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787599780.045443:0:24165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c923b8/0x5d2988b0929d1192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787599780.046348:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787599780.046360:0:24165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.046392:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=726s v=(0 0) 00010000:00010000:2.0:1787599780.046398:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599780.046405:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.046422:0:24165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.046432:0:24165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.046440:0:24165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599780.046464:0:24165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787599780.046510:0:24165:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:3.0:1787599780.046618:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599780.046627:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.046647:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c800 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599780.046651:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.046661:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.046677:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.046685:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567d7003/0x5d2988b0929d1199 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599780.046702:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599780.046704:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599780.046706:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599780.046975:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22687:x1874433578108032:12345-0@lo:5:osp-pre-1-0.0 Request processed in 151376us (151641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599780.046985:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1787599780.047070:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599780.047645:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874433578108032:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787599780.047665:0:22687:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787599780.047711:0:22687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874433578108544:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787599780.047755:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599780.048007:0:22687:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599780.050674:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108544 00000100:00100000:0.0:1787599780.050691:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108544 00000100:00100000:0.0:1787599780.050757:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787599780.050768:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22687:x1874433578108544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787599780.050829:0:24501:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:1.0:1787599780.065855:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22687:x1874433578108544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15081us (18091us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787599780.065871:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787599780.066111:0:22687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22687:1874433578108544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787599780.066127:0:22687:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1787599780.201994:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599781.226947:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599781.413075:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787599781.413105:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578108672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599781.413179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599781.413272:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108672 00000100:00100000:0.0:1787599781.413281:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108672 00000100:00100000:0.0:1787599781.413338:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787599781.413356:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578108672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599781.413416:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787599781.413463:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578108672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599781.413471:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787599781.413653:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578108672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599781.413996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599781.414005:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578108800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599781.414033:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599781.414107:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108800 00000100:00100000:1.0:1787599781.414110:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108800 00000100:00100000:1.0:1787599781.414138:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787599781.414143:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578108800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599781.414172:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599781.414202:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578108800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599781.414209:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599781.414282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578108800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599781.414609:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578108928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599781.414633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599781.414714:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578108928 00000100:00100000:0.0:1787599781.414718:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578108928 00000100:00100000:0.0:1787599781.414819:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787599781.414828:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578108928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599781.414850:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599781.414882:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578108928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599781.414896:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787599781.416516:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599781.416591:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578108928:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787599782.246672:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599782.314432:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787599782.917735:0:25341:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg201-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787599783.271741:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599784.148123:0:25394:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599784.148334:0:25394:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787599784.296614:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599784.498366:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599784.498389:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578109056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599784.498468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599784.499257:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109056 00000100:00100000:3.0:1787599784.499268:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109056 00000100:00100000:3.0:1787599784.499327:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787599784.499337:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578109056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599784.504761:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599784.504893:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578109056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5553us (6421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599784.504903:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787599784.504934:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599784.505741:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578109056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599784.998452:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578109184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599784.999412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.001379:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578109312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599785.001461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.001553:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109184 00000100:00100000:0.0:1787599785.001561:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109184 00000100:00100000:0.0:1787599785.001606:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109312 00000100:00100000:0.0:1787599785.001610:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109312 00000100:00100000:0.0:1787599785.001632:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599785.001641:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578109184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787599785.001673:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787599785.001721:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578109184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.001728:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599785.001745:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599785.001751:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578109312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787599785.001761:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787599785.001822:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578109312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.001828:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787599785.001843:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787599785.001882:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578109184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787599785.001930:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578109312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599785.008738:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578109440:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.008862:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.008916:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578109952:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.008948:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.008973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578110464:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.009097:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787599785.009105:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578109568:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.009165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578110080:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.009228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578110592:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009253:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599785.009303:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109440 00000100:00100000:0.0:1787599785.009311:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109440 00000100:00100000:0.0:1787599785.009375:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787599785.009385:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009439:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578109440:12345-0@lo:400:kworker.0 Request processed in 56us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.009460:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787599785.009498:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110464 00000100:00100000:0.0:1787599785.009740:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110464 00000100:00100000:0.0:1787599785.009819:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110080 00000100:00100000:0.0:1787599785.009823:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110080 00000100:00100000:0.0:1787599785.009854:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110592 00000100:00100000:0.0:1787599785.009856:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110592 00000100:00100000:0.0:1787599785.009869:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599785.009876:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578110464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009914:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578110464:12345-0@lo:400:kworker.0 Request processed in 39us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.009921:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787599785.009932:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599785.009938:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578110080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.009964:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578110080:12345-0@lo:400:kworker.0 Request processed in 26us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.009969:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787599785.009980:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599785.009986:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578110592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.010010:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578110592:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.010016:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787599785.010034:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109568 00000100:00100000:0.0:1787599785.010038:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109568 00000100:00100000:0.0:1787599785.010061:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787599785.010067:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578109568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.010098:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578109568:12345-0@lo:400:kworker.0 Request processed in 31us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.010105:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787599785.010128:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787599785.010132:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787599785.010165:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578109568:0@lo:400:kworker.0 00010000:00080000:0.0:1787599785.010202:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ac000 x1874433578110080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.010212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578110080:0@lo:400:kworker.0 00010000:00080000:0.0:1787599785.010222:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b370011880 x1874433578110592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.010230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578110592:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.010240:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578109440:0@lo:400:kworker.0 00010000:00080000:0.0:1787599785.010248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ae680 x1874433578110464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.010254:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578110464:0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.010667:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109952 00000100:00100000:2.0:1787599785.010673:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109952 00000100:00100000:2.0:1787599785.010725:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599785.010733:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578109952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.010826:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578109952:12345-0@lo:400:kworker.0 Request processed in 93us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.010833:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787599785.010865:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578109696:0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.010898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599785.010919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578110208:0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.010941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599785.010958:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787599785.010965:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578109824:0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.010988:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599785.011004:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578110336:0@lo:400:kworker.0 00000100:00100000:2.0:1787599785.011024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787599785.011409:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599785.011424:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109696 00000100:00100000:0.0:1787599785.011429:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109696 00000100:00100000:0.0:1787599785.011464:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110208 00000100:00100000:0.0:1787599785.011467:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110208 00000100:00100000:0.0:1787599785.011489:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110336 00000100:00100000:0.0:1787599785.011492:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110336 00000100:00100000:0.0:1787599785.011522:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599785.011532:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011582:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578109696:12345-0@lo:400:kworker.0 Request processed in 51us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.011588:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787599785.011602:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599785.011609:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578110208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011653:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578110208:12345-0@lo:400:kworker.0 Request processed in 45us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.011659:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787599785.011671:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787599785.011677:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578110336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011704:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874433578110336:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.011710:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787599785.011752:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433afb80 x1874433578110336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.011764:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1874433578110336:0@lo:400:kworker.0 00010000:00080000:0.0:1787599785.011808:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ae300 x1874433578109696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.011817:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578109696:0@lo:400:kworker.0 00010000:00080000:0.0:1787599785.011828:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2433ace00 x1874433578110208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787599785.011835:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578110208:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011857:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578109824 00000100:00100000:0.0:1787599785.011860:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578109824 00000100:00100000:0.0:1787599785.011882:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599785.011888:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011924:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578109824:12345-0@lo:400:kworker.0 Request processed in 36us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.011930:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787599785.011965:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578109824:0@lo:400:kworker.0 00000100:00100000:0.0:1787599785.011994:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578109952:0@lo:400:kworker.0 00000100:00080000:2.0:1787599785.012465:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599785.012469:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787599785.316962:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787599785.383033:0:25444:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787599785.383400:0:25444:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1787599785.525092:0:24984:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:3.0:1787599785.707770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.708091:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116672 00000100:00100000:1.0:1787599785.708102:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116672 00000100:00100000:1.0:1787599785.708149:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:1.0:1787599785.708159:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2402:x1874433559116672:12345-192.168.202.1@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787599785.708190:0:22654:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 29d15dc6-6015-48f9-a685-073cccef6f3e@192.168.202.1@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1787599785.708219:0:22654:0:(genops.c:1385:class_connect()) connect: client 29d15dc6-6015-48f9-a685-073cccef6f3e, cookie 0x5d2988b0929d11a0 00000100:00080000:1.0:1787599785.708400:0:22654:0:(import.c:65:import_set_state_nolock()) ffff96b242ce1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599785.708475:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+5:2402:x1874433559116672:12345-192.168.202.1@tcp:250:mount.lustre.0 Request processed in 315us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.708483:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 118 00000100:00100000:3.0:1787599785.723696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.723860:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116800 00000100:00100000:0.0:1787599785.723871:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116800 00000100:00100000:0.0:1787599785.723925:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:0.0:1787599785.723936:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+5:18059:x1874433559116800:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787599785.723955:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599785.723974:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3c400/0x5d2988b0929d11a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc083 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599785.724003:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3c400/0x5d2988b0929d11a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc083 expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599785.724015:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3c400/0x5d2988b0929d11a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc083 expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599785.724024:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c400, rc 0) 00000100:00100000:0.0:1787599785.724085:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+6:18059:x1874433559116800:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 150us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.724092:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 119 00000100:00100000:2.0:1787599785.739315:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.739429:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559116928 00000100:00100000:0.0:1787599785.739438:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559116928 00000100:00100000:0.0:1787599785.739506:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:0.0:1787599785.739517:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+6:18059:x1874433559116928:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787599785.739666:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+6:18059:x1874433559116928:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 149us (361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599785.739674:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 120 00000100:00100000:3.0:1787599785.741453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.741586:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117056 00000100:00100000:1.0:1787599785.741597:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117056 00000100:00100000:1.0:1787599785.741657:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:1.0:1787599785.741667:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+6:18059:x1874433559117056:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599785.741693:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599785.741714:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d11ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc08a expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.741743:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d11ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc08a expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.741755:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54bc00/0x5d2988b0929d11ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc08a expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.741765:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54bc00, rc 0) 00000100:00100000:1.0:1787599785.741880:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+7:18059:x1874433559117056:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 213us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.741887:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 121 00000100:00100000:3.0:1787599785.744301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.744391:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117184 00000100:00100000:1.0:1787599785.744401:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117184 00000100:00100000:1.0:1787599785.744462:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:1.0:1787599785.744472:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+7:18059:x1874433559117184:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787599785.746894:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18059:x1874433559117184:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 2412us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.746911:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 122 00000100:00100000:2.0:1787599785.750917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.751131:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117312 00000100:00100000:1.0:1787599785.751142:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117312 00000100:00100000:1.0:1787599785.751192:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:1.0:1787599785.751203:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18059:x1874433559117312:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787599785.751366:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18059:x1874433559117312:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 164us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.751374:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 123 00000100:00100000:3.0:1787599785.754196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.754484:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117440 00000100:00100000:1.0:1787599785.754675:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117440 00000100:00100000:0.0:1787599785.754913:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 124 00000100:00100000:0.0:1787599785.754928:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117440:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599785.755092:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117440:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 168us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.755101:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 124 00000040:00080000:3.0:1787599785.768314:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787599785.793559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.793635:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117568 00000100:00100000:1.0:1787599785.793647:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117568 00000100:00100000:1.0:1787599785.794620:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:1.0:1787599785.794636:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117568:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787599785.798168:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117568:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 3525us (4610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.798183:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 125 00000100:00100000:2.0:1787599785.808588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.808633:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117696 00000100:00100000:2.0:1787599785.808644:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117696 00000100:00100000:2.0:1787599785.808699:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1787599785.808710:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117696:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599785.808898:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18077:x1874433559117696:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 189us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.808906:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 126 00000100:00100000:2.0:1787599785.813923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.814186:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117824 00000100:00100000:1.0:1787599785.814198:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117824 00000100:00100000:1.0:1787599785.814273:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:1.0:1787599785.814285:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37784d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+8:18059:x1874433559117824:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787599785.814303:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599785.814321:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d11b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc0bb expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.814360:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0bb expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.814373:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b37b54a000/0x5d2988b0929d11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0bb expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599785.814383:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54a000, rc 0) 00000100:00100000:1.0:1787599785.814451:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37784d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+9:18059:x1874433559117824:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 167us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.814458:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 127 00000100:00100000:2.0:1787599785.836935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.838867:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559117952 00000100:00100000:0.0:1787599785.838882:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559117952 00000100:00100000:2.0:1787599785.839583:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:2.0:1787599785.839598:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+9:18059:x1874433559117952:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787599785.839625:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787599785.839651:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787599785.839654:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787599785.839657:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787599785.839660:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787599785.839662:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787599785.842174:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+9:18059:x1874433559117952:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 2568us (5241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.842188:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 128 00000100:00100000:3.0:1787599785.845993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.847376:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118080 00000100:00100000:2.0:1787599785.847391:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118080 00000100:00100000:2.0:1787599785.847506:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:2.0:1787599785.847517:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+9:18059:x1874433559118080:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599785.847536:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599785.847558:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc0c2 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599785.847588:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599785.847600:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599785.847610:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6c000, rc 0) 00000100:00100000:2.0:1787599785.847688:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18059:x1874433559118080:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 173us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.847696:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 129 00000100:00100000:3.0:1787599785.850149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.850679:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118208 00000100:00100000:1.0:1787599785.850689:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118208 00000100:00100000:1.0:1787599785.850735:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:1.0:1787599785.850744:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18059:x1874433559118208:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787599785.851111:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18059:x1874433559118208:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 365us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.851121:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 130 00000100:00100000:3.0:1787599785.854670:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.854822:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118336 00000100:00100000:2.0:1787599785.854832:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118336 00000100:00100000:2.0:1787599785.854911:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:2.0:1787599785.854921:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18059:x1874433559118336:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787599785.855229:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18059:x1874433559118336:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 309us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.855237:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 131 00000100:00100000:1.0:1787599785.858900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.859271:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118464 00000100:00100000:2.0:1787599785.859283:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118464 00000100:00100000:2.0:1787599785.859347:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:2.0:1787599785.859357:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18083:x1874433559118464:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599785.859757:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18083:x1874433559118464:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 401us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.859766:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 132 00000100:00100000:3.0:1787599785.862575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.862720:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118592 00000100:00100000:0.0:1787599785.862729:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118592 00000100:00100000:0.0:1787599785.862786:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:0.0:1787599785.862826:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18083:x1874433559118592:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599785.862968:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18083:x1874433559118592:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.862976:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 133 00000100:00100000:3.0:1787599785.872085:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.872533:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118720 00000100:00100000:0.0:1787599785.872545:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118720 00000100:00100000:0.0:1787599785.872606:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1787599785.872616:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2402:x1874433559118720:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787599785.872647:0:22662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 07a4010e-4a97-45be-a56f-11284301c754@192.168.202.1@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787599785.872724:0:22662:0:(genops.c:1385:class_connect()) connect: client 07a4010e-4a97-45be-a56f-11284301c754, cookie 0x5d2988b0929d11c3 00000004:00100000:0.0:1787599785.872753:0:22662:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787599785.873013:0:22662:0:(import.c:65:import_set_state_nolock()) ffff96b2441eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599785.873088:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+6:2402:x1874433559118720:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 471us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.873095:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1787599785.873588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.874067:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118976 00000100:00100000:0.0:1787599785.874075:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118976 00000100:00100000:0.0:1787599785.874117:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:0.0:1787599785.874125:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874433559118976:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787599785.874148:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 07a4010e-4a97-45be-a56f-11284301c754@192.168.202.1@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787599785.874189:0:22661:0:(genops.c:1385:class_connect()) connect: client 07a4010e-4a97-45be-a56f-11284301c754, cookie 0x5d2988b0929d11ca 00000004:00100000:0.0:1787599785.874209:0:22661:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787599785.875903:0:22661:0:(import.c:65:import_set_state_nolock()) ffff96b3706e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787599785.875988:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+6:2402:x1874433559118976:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 1860us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.875998:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:3.0:1787599785.877368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.877982:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119232 00000100:00100000:0.0:1787599785.877991:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119232 00000100:00100000:0.0:1787599785.878085:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:0.0:1787599785.878097:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119232:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787599785.878136:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1787599785.879082:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599785.883426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.883784:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559118848 00000100:00100000:2.0:1787599785.883840:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559118848 00000100:00100000:2.0:1787599785.883901:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1787599785.883913:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+7:0:x1874433559118848:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787599785.883947:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599785.884051:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+7:0:x1874433559118848:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 141us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.884058:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:3.0:1787599785.886161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.886390:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119104 00000100:00100000:2.0:1787599785.886401:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119104 00000100:00100000:2.0:1787599785.886530:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1787599785.886541:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+6:0:x1874433559119104:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787599785.886589:0:24662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599785.886720:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+6:0:x1874433559119104:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 181us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.886728:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1787599785.889705:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119232:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 11598us (12332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.889732:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00080000:0.0:1787599785.891767:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599785.894874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599785.895019:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119360 00000100:00100000:0.0:1787599785.895031:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119360 00000100:00100000:0.0:1787599785.895096:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:0.0:1787599785.895119:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119360:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787599785.895210:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b351769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119360:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599785.895393:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 12 00000100:00100000:2.0:1787599785.897889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.897925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.898182:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119488 00000100:00100000:1.0:1787599785.898192:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119488 00000100:00100000:1.0:1787599785.898237:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119616 00000100:00100000:1.0:1787599785.898241:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119616 00000100:00100000:1.0:1787599785.898266:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599785.898275:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559119488:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599785.898310:0:24501:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 07a4010e-4a97-45be-a56f-11284301c754@192.168.202.1@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1787599785.898352:0:24501:0:(genops.c:1385:class_connect()) connect: client 07a4010e-4a97-45be-a56f-11284301c754, cookie 0x5d2988b0929d11d1 00002000:00100000:1.0:1787599785.898364:0:24501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07a4010e-4a97-45be-a56f-11284301c754/ffff96b242ce7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599785.898374:0:24501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599785.898558:0:24501:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787599785.898590:0:24501:0:(import.c:65:import_set_state_nolock()) ffff96b242ce0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599785.898656:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+6:2402:x1874433559119488:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 380us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.898663:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:1.0:1787599785.898683:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:1.0:1787599785.898688:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2402:x1874433559119616:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787599785.898703:0:24501:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 07a4010e-4a97-45be-a56f-11284301c754@192.168.202.1@tcp t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:1.0:1787599785.898720:0:24501:0:(genops.c:1385:class_connect()) connect: client 07a4010e-4a97-45be-a56f-11284301c754, cookie 0x5d2988b0929d11d8 00002000:00100000:1.0:1787599785.898726:0:24501:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07a4010e-4a97-45be-a56f-11284301c754/ffff96b242ce3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787599785.898732:0:24501:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787599785.898880:0:24501:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787599785.898896:0:24501:0:(import.c:65:import_set_state_nolock()) ffff96b242ce4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599785.898932:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+6:2402:x1874433559119616:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 243us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.898939:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:3.0:1787599785.901133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599785.901249:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119744 00000100:00100000:2.0:1787599785.901259:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119744 00000100:00100000:2.0:1787599785.901322:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:2.0:1787599785.901343:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119744:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787599785.901426:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119744:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 94us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599785.901433:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1787599785.904741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599785.905349:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559119872 00000100:00100000:1.0:1787599785.905362:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559119872 00000100:00100000:1.0:1787599785.905468:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599785.905478:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119872:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787599785.911142:0:22663:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5538us 00000004:00200000:1.0:1787599785.931150:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787599785.931288:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+6:18059:x1874433559119872:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 25805us (26551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599785.931299:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1787599786.179021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599786.179602:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120000 00000100:00100000:1.0:1787599786.179614:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120000 00000100:00100000:1.0:1787599786.179683:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:1.0:1787599786.179693:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+6:18106:x1874433559120000:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:1.0:1787599786.179716:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599786.179743:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b800/0x5d2988b0929d11df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc0f3 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180023:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180039:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180054:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599786.180102:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787599786.180122:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599786.180382:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180414:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54b800/0x5d2988b0929d11df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0f3 expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180431:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0f3 expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599786.180439:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:1.0:1787599786.180442:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599786.180446:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b37b54ae00, rc 0) 00000100:00100000:1.0:1787599786.181839:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+7:18106:x1874433559120000:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 2137us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599786.181861:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:1.0:1787599786.343133:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599786.541879:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578110848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787599786.541965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599786.542023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599786.542030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578110720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599786.542054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599786.542089:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110848 00000100:00100000:2.0:1787599786.542096:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110848 00000100:00100000:2.0:1787599786.542132:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110720 00000100:00100000:2.0:1787599786.542134:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110720 00000100:00100000:2.0:1787599786.542148:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599786.542156:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578110848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599786.542198:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599786.542243:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578110848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599786.542266:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787599786.542285:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599786.542291:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578110720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787599786.542307:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599786.542365:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578110720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599786.542372:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787599786.542409:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578110720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787599786.542419:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578110848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787599786.543136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578110976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599786.543176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599786.543417:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578110976 00000100:00100000:0.0:1787599786.543423:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578110976 00000100:00100000:0.0:1787599786.543464:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599786.543472:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578110976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787599786.543500:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599786.543584:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578110976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599786.543591:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787599786.543858:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578110976:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787599787.365492:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599788.388967:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599788.586682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.588352:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120128 00000100:00100000:2.0:1787599788.588368:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120128 00000100:00100000:2.0:1787599788.588476:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1787599788.588490:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+7:18158:x1874433559120128:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:2.0:1787599788.588530:0:24662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599788.588628:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+7:18158:x1874433559120128:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 142us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.588635:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:0.0:1787599788.588878:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599788.598646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.599083:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120256 00000100:00100000:2.0:1787599788.599094:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120256 00000100:00100000:2.0:1787599788.599167:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:2.0:1787599788.599180:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120256:12345-192.168.202.1@tcp:41:lfs.0 00000004:00000024:2.0:1787599788.599221:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787599788.599324:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120256:12345-192.168.202.1@tcp:41:lfs.0 Request processed in 146us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.599347:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:0.0:1787599788.599675:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599788.605386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599788.605618:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120384 00000100:00100000:0.0:1787599788.605629:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120384 00000100:00100000:0.0:1787599788.605707:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1787599788.605718:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120384:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:0.0:1787599788.605750:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787599788.605873:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120384:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 157us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599788.605882:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00080000:2.0:1787599788.606149:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787599788.608294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599788.608587:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120512 00000100:00100000:0.0:1787599788.608597:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120512 00000100:00100000:0.0:1787599788.608716:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:0.0:1787599788.608726:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120512:12345-192.168.202.1@tcp:13:lfs.0 00002000:00000024:0.0:1787599788.608772:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787599788.608885:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07a4010e-4a97-45be-a56f-11284301c754+6:18158:x1874433559120512:12345-192.168.202.1@tcp:13:lfs.0 Request processed in 160us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599788.608893:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00080000:2.0:1787599788.613303:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787599788.862371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.862537:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120640 00000100:00100000:2.0:1787599788.862550:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120640 00000100:00100000:2.0:1787599788.862616:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:2.0:1787599788.862627:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+10:18192:x1874433559120640:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599788.862643:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599788.862661:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef6de00/0x5d2988b0929d11ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc0fa expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599788.862700:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef6de00/0x5d2988b0929d11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0fa expref: 11 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599788.862712:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef6de00/0x5d2988b0929d11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0fa expref: 11 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599788.862722:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6de00, rc 0) 00000100:00100000:2.0:1787599788.862784:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3778d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559120640:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 158us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.862830:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 134 00000100:00100000:1.0:1787599788.869705:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.869859:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120768 00000100:00100000:2.0:1787599788.869868:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120768 00000100:00100000:2.0:1787599788.869925:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:2.0:1787599788.869935:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559120768:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787599788.870096:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559120768:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 162us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.870121:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 135 00000100:00100000:3.0:1787599788.874239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599788.874434:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559120896 00000100:00100000:0.0:1787599788.874445:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559120896 00000100:00100000:0.0:1787599788.874515:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:0.0:1787599788.874525:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559120896:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787599788.874670:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559120896:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599788.874678:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 136 00000100:00100000:1.0:1787599788.880944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599788.881336:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121024 00000100:00100000:0.0:1787599788.881346:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121024 00000100:00100000:0.0:1787599788.881415:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:0.0:1787599788.881427:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121024:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599788.881626:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121024:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 200us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599788.881634:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 137 00000100:00100000:1.0:1787599788.935645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.936126:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121152 00000100:00100000:2.0:1787599788.936136:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121152 00000100:00100000:2.0:1787599788.936195:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:2.0:1787599788.936206:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121152:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599788.936364:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121152:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 159us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.936373:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 138 00000100:00100000:3.0:1787599788.966385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599788.967216:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121280 00000100:00100000:2.0:1787599788.967227:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121280 00000100:00100000:2.0:1787599788.967295:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:2.0:1787599788.967315:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121280:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787599788.967570:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18197:x1874433559121280:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 264us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599788.967578:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 139 00000100:00100000:1.0:1787599788.984684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599788.984764:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121408 00000100:00100000:0.0:1787599788.984777:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121408 00000100:00100000:0.0:1787599788.984877:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:0.0:1787599788.984890:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18192:x1874433559121408:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787599788.984906:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599788.984924:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d600/0x5d2988b0929d11f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc12b expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599788.984971:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d600/0x5d2988b0929d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc12b expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599788.985001:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3d600/0x5d2988b0929d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc12b expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599788.985010:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3d600, rc 0) 00000100:00100000:0.0:1787599788.985070:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18192:x1874433559121408:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 183us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599788.985077:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 140 00000100:00100000:3.0:1787599788.992359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599788.992454:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121536 00000100:00100000:1.0:1787599788.992471:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121536 00000100:00100000:1.0:1787599788.992546:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:1.0:1787599788.992556:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18192:x1874433559121536:12345-192.168.202.1@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787599788.992582:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787599788.992598:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787599788.992602:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787599788.992605:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787599788.992608:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787599788.992611:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787599788.994764:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18192:x1874433559121536:12345-192.168.202.1@tcp:256:mount.lustre.0 Request processed in 2197us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599788.994777:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 141 00000100:00100000:3.0:1787599789.001680:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599789.001836:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121664 00000100:00100000:2.0:1787599789.001846:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121664 00000100:00100000:2.0:1787599789.001907:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:2.0:1787599789.001918:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18192:x1874433559121664:12345-192.168.202.1@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787599789.001935:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599789.001952:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc132 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599789.001992:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599789.002025:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599789.002035:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6d600, rc 0) 00000100:00100000:2.0:1787599789.002102:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18192:x1874433559121664:12345-192.168.202.1@tcp:101:mount.lustre.0 Request processed in 185us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599789.002108:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 142 00000100:00100000:3.0:1787599789.005700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599789.006950:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121792 00000100:00100000:1.0:1787599789.006965:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121792 00000100:00100000:1.0:1787599789.007105:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:1.0:1787599789.007238:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18192:x1874433559121792:12345-192.168.202.1@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787599789.007409:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243555850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18192:x1874433559121792:12345-192.168.202.1@tcp:501:mount.lustre.0 Request processed in 176us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599789.007418:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 143 00000100:00100000:3.0:1787599789.010450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599789.011682:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559121920 00000100:00100000:0.0:1787599789.011698:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559121920 00000100:00100000:0.0:1787599789.011840:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:0.0:1787599789.011851:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18192:x1874433559121920:12345-192.168.202.1@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787599789.012029:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243556450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18192:x1874433559121920:12345-192.168.202.1@tcp:503:mount.lustre.0 Request processed in 179us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599789.012037:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 144 00000100:00100000:2.0:1787599789.021380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599789.021882:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122048 00000100:00100000:0.0:1787599789.021893:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122048 00000100:00100000:0.0:1787599789.022011:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:0.0:1787599789.022022:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18201:x1874433559122048:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599789.022192:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18201:x1874433559122048:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 171us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599789.022200:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 145 00000100:00100000:3.0:1787599789.029863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599789.030175:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122176 00000100:00100000:0.0:1787599789.030200:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122176 00000100:00100000:0.0:1787599789.030317:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:0.0:1787599789.030328:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18201:x1874433559122176:12345-192.168.202.1@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787599789.030479:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18201:x1874433559122176:12345-192.168.202.1@tcp:502:llog_process_th.0 Request processed in 152us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599789.030487:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 146 00000100:00100000:3.0:1787599789.044702:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599789.044753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599789.045207:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122304 00000100:00100000:1.0:1787599789.045217:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122304 00000100:00100000:1.0:1787599789.045257:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122560 00000100:00100000:1.0:1787599789.045260:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122560 00000100:00100000:1.0:1787599789.045284:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1787599789.045292:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874433559122304:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787599789.045331:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a0a33c25-965c-43ee-9328-e2b907b291c8@192.168.202.1@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:1.0:1787599789.045371:0:22661:0:(genops.c:1385:class_connect()) connect: client a0a33c25-965c-43ee-9328-e2b907b291c8, cookie 0x5d2988b0929d1202 00000004:00100000:1.0:1787599789.045395:0:22661:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787599789.045512:0:22661:0:(import.c:65:import_set_state_nolock()) ffff96b366637000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599789.045647:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2402:x1874433559122304:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 353us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599789.045654:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:1.0:1787599789.045673:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1787599789.045677:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2402:x1874433559122560:12345-192.168.202.1@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787599789.045693:0:22661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a0a33c25-965c-43ee-9328-e2b907b291c8@192.168.202.1@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:1.0:1787599789.045712:0:22661:0:(genops.c:1385:class_connect()) connect: client a0a33c25-965c-43ee-9328-e2b907b291c8, cookie 0x5d2988b0929d1209 00000004:00100000:1.0:1787599789.045724:0:22661:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787599789.045767:0:22661:0:(import.c:65:import_set_state_nolock()) ffff96b366632000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787599789.046657:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2402:x1874433559122560:12345-192.168.202.1@tcp:38:mount.lustre.0 Request processed in 113us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599789.046668:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599789.061193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599789.061231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599789.061324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599789.061434:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122688 00000100:00100000:3.0:1787599789.061444:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122688 00000100:00100000:3.0:1787599789.061512:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122432 00000100:00100000:3.0:1787599789.061525:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122432 00000100:00100000:3.0:1787599789.061542:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122816 00000100:00100000:3.0:1787599789.061544:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122816 00000100:00100000:3.0:1787599789.061559:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599789.061569:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:0:x1874433559122688:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599789.061603:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787599789.061692:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:0:x1874433559122688:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 124us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599789.061699:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:3.0:1787599789.061717:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599789.061723:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+7:0:x1874433559122432:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599789.061737:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787599789.061766:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+7:0:x1874433559122432:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 43us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599789.061772:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:3.0:1787599789.061783:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:3.0:1787599789.061789:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559122816:12345-192.168.202.1@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787599789.061824:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787599789.061844:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559122816:12345-192.168.202.1@tcp:41:mount.lustre.0 Request processed in 55us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599789.061850:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00080000:2.0:1787599789.062552:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599789.062558:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599789.069196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599789.069361:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559122944 00000100:00100000:2.0:1787599789.069371:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559122944 00000100:00100000:2.0:1787599789.069429:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599789.069440:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559122944:12345-192.168.202.1@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787599789.069558:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559122944:12345-192.168.202.1@tcp:40:mount.lustre.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599789.069566:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:3.0:1787599789.078645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599789.079099:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123328 00000100:00100000:2.0:1787599789.079110:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123328 00000100:00100000:2.0:1787599789.079166:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:2.0:1787599789.079175:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559123328:12345-192.168.202.1@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787599789.079251:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559123328:12345-192.168.202.1@tcp:900:mount.lustre.0 Request processed in 77us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599789.079271:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599789.090456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599789.094850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599789.103087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599789.103261:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123456 00000100:00100000:1.0:1787599789.103272:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123456 00000100:00100000:1.0:1787599789.103335:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1787599789.103345:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559123456:12345-192.168.202.1@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787599789.103427:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787599789.103505:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18192:x1874433559123456:12345-192.168.202.1@tcp:33:mount.lustre.0 Request processed in 161us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599789.103523:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:3.0:1787599789.103756:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123072 00000100:00100000:3.0:1787599789.103762:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123072 00000100:00100000:2.0:1787599789.109365:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123200 00000100:00100000:2.0:1787599789.109379:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123200 00000100:00100000:2.0:1787599789.109429:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1787599789.109438:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2402:x1874433559123072:12345-192.168.202.1@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787599789.110716:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:3.0:1787599789.110726:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2402:x1874433559123200:12345-192.168.202.1@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787599789.110763:0:24165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a0a33c25-965c-43ee-9328-e2b907b291c8@192.168.202.1@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:3.0:1787599789.110837:0:24165:0:(genops.c:1385:class_connect()) connect: client a0a33c25-965c-43ee-9328-e2b907b291c8, cookie 0x5d2988b0929d1210 00002000:00100000:3.0:1787599789.110850:0:24165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a0a33c25-965c-43ee-9328-e2b907b291c8/ffff96b345911000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787599789.110887:0:24165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787599789.110958:0:24165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787599789.111003:0:24165:0:(import.c:65:import_set_state_nolock()) ffff96b345913000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787599789.111079:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2402:x1874433559123200:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 351us (16237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599789.111087:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00010000:00080000:2.0:1787599789.112000:0:24168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a0a33c25-965c-43ee-9328-e2b907b291c8@192.168.202.1@tcp t0 exp 0000000000000000 cur 735 last 0 00000020:00000080:2.0:1787599789.112028:0:24168:0:(genops.c:1385:class_connect()) connect: client a0a33c25-965c-43ee-9328-e2b907b291c8, cookie 0x5d2988b0929d1217 00002000:00100000:2.0:1787599789.112037:0:24168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a0a33c25-965c-43ee-9328-e2b907b291c8/ffff96b37dbac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787599789.112046:0:24168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787599789.112094:0:24168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787599789.112118:0:24168:0:(import.c:65:import_set_state_nolock()) ffff96b37dbab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787599789.112163:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2402:x1874433559123072:12345-192.168.202.1@tcp:8:mount.lustre.0 Request processed in 2723us (21718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599789.112170:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00010000:00010000:2.0:1787599789.421237:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599789.422960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599789.423074:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123584 00000100:00100000:0.0:1787599789.423086:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123584 00000100:00100000:0.0:1787599789.423163:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1787599789.423174:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18224:x1874433559123584:12345-192.168.202.1@tcp:101:mkdir.0 00010000:00010000:0.0:1787599789.423194:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599789.423216:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d121e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc163 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423278:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423292:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423313:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599789.423358:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599789.423362:0:24662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599789.423382:0:24662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423408:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d121e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 8 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423436:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 7 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599789.423444:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:0.0:1787599789.423460:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599789.423469:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c800, rc 0) 00000100:00100000:0.0:1787599789.423870:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+7:18224:x1874433559123584:12345-192.168.202.1@tcp:101:mkdir.0 Request processed in 696us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599789.423878:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:0.0:1787599789.605882:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787599789.605908:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578111104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787599789.605978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599789.606041:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111104 00000100:00100000:3.0:1787599789.606049:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111104 00000100:00100000:3.0:1787599789.606124:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787599789.606135:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578111104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787599789.606159:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599789.606212:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578111104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599789.606220:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787599789.606262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578111104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599789.606322:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787599790.117621:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599790.117645:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787599790.117717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599790.117727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787599790.117738:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578111360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599790.117765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599790.117846:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111232 00000100:00100000:1.0:1787599790.117854:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111232 00000100:00100000:1.0:1787599790.117920:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111360 00000100:00100000:1.0:1787599790.117924:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111360 00000100:00100000:1.0:1787599790.117943:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599790.117951:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578111232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599790.117973:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599790.118019:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578111232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599790.118026:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787599790.118042:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599790.118048:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578111360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599790.118057:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599790.118078:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578111360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599790.118083:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787599790.118100:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578111872:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.118101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578111616:0@lo:400:kworker.0 00000100:00100000:1.0:1787599790.118126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.118129:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578111744:0@lo:400:kworker.0 00000100:00080000:0.0:1787599790.118187:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599790.118190:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578111488:0@lo:400:kworker.0 00000100:00100000:0.0:1787599790.118209:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111872 00000100:00100000:0.0:1787599790.118213:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111872 00000100:00100000:0.0:1787599790.118243:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787599790.118249:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578111872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.125992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.126060:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578112256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.126154:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578111360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787599790.126210:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111744 00000100:00100000:3.0:1787599790.126216:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111744 00000100:00100000:3.0:1787599790.126268:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112256 00000100:00100000:3.0:1787599790.126271:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112256 00000100:00100000:3.0:1787599790.126326:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599790.126335:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578111744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126400:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578111744:12345-0@lo:400:kworker.0 Request processed in 66us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.126408:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787599790.126426:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787599790.126432:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126482:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578112256:12345-0@lo:400:kworker.0 Request processed in 50us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.126488:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787599790.126504:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787599790.126527:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578111744:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126539:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578112256:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.126624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578112128:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.126677:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578112640:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599790.126721:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112128 00000100:00100000:3.0:1787599790.126725:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112128 00000100:00100000:3.0:1787599790.126741:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112640 00000100:00100000:3.0:1787599790.126743:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112640 00000100:00100000:3.0:1787599790.126760:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599790.126765:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126830:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874433578112128:12345-0@lo:400:kworker.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.126837:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787599790.126858:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599790.126864:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578112640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.126893:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874433578112640:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.126898:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787599790.126914:0:22666:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787599790.126921:0:22666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1787599790.126934:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599790.126952:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874433578112128:0@lo:400:kworker.0 00010000:00080000:3.0:1787599790.126965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa07800 x1874433578112640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787599790.126975:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1874433578112640:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.127098:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111616 00000100:00100000:1.0:1787599790.127099:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578112384:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.127102:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111616 00000100:00100000:1.0:1787599790.127126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599790.127159:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112384 00000100:00100000:1.0:1787599790.127163:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112384 00000100:00100000:1.0:1787599790.127192:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599790.127198:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787599790.127198:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578112384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.127204:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578111616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599790.127227:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578112384:12345-0@lo:400:kworker.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.127233:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874433578111616:12345-0@lo:400:kworker.0 Request processed in 29us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599790.127233:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787599790.127238:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787599790.127247:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787599790.127257:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1874433578111616:0@lo:400:kworker.0 00010000:00080000:1.0:1787599790.127268:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b37fa04700 x1874433578112384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599790.127278:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578112384:0@lo:400:kworker.0 00000100:00100000:1.0:1787599790.127289:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1787599790.127316:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599790.127508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599790.127548:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578112000:0@lo:400:kworker.0 00000100:00100000:2.0:1787599790.127574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599790.127598:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578112512:0@lo:400:kworker.0 00000100:00100000:2.0:1787599790.127629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599790.127661:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112512 00000100:00100000:2.0:1787599790.127664:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112512 00000100:00100000:1.0:1787599790.127668:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578111488 00000100:00100000:1.0:1787599790.127671:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578111488 00000100:00100000:2.0:1787599790.127693:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599790.127693:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787599790.127699:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578112512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599790.127699:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599790.127728:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578112512:12345-0@lo:400:kworker.0 Request processed in 29us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599790.127728:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243557050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578111488:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599790.127735:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787599790.127735:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1787599790.127750:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599790.127767:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578112512:0@lo:400:kworker.0 00000100:00100000:2.0:1787599790.127783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578111488:0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.127992:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112000 00000100:00100000:3.0:1787599790.127996:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112000 00000100:00100000:3.0:1787599790.128023:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787599790.128029:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578112000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787599790.128061:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578112000:12345-0@lo:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599790.128075:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787599790.128227:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599790.130216:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787599790.136990:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578111872:12345-0@lo:400:kworker.0 Request processed in 18728us (18850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599790.137006:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787599790.137157:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578111872:0@lo:400:kworker.0 00010000:00010000:3.0:1787599790.436963:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787599791.154542:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a0a33c25-965c-43ee-9328-e2b907b291c8 00000001:00100000:1.0:1787599791.154560:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07a4010e-4a97-45be-a56f-11284301c754 00000001:00100000:0.0:1787599791.155583:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a0a33c25-965c-43ee-9328-e2b907b291c8 00000001:00100000:0.0:1787599791.155592:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07a4010e-4a97-45be-a56f-11284301c754 00000001:00100000:2.0:1787599791.156559:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a0a33c25-965c-43ee-9328-e2b907b291c8 00000001:00100000:2.0:1787599791.156570:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 07a4010e-4a97-45be-a56f-11284301c754 00000001:00100000:0.0:1787599791.159587:0:24162:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a0a33c25-965c-43ee-9328-e2b907b291c8 00000001:00100000:0.0:1787599791.159601:0:24162:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07a4010e-4a97-45be-a56f-11284301c754 00010000:00010000:0.0:1787599791.461223:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787599791.653097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578112896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599791.653193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599791.653200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578112768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599791.653233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599791.653261:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787599791.653269:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787599791.653312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599791.653330:0:25458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112896 00000100:00100000:0.0:1787599791.653335:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113024 00000100:00100000:3.0:1787599791.653337:0:25458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112896 00000100:00100000:0.0:1787599791.653337:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113024 00000100:00100000:3.0:1787599791.653375:0:25458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578112768 00000100:00100000:3.0:1787599791.653377:0:25458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578112768 00000100:00100000:0.0:1787599791.653378:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787599791.653386:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578113024:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599791.653388:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787599791.653393:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578112896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787599791.653414:0:25458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00002000:00000024:0.0:1787599791.653414:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787599791.653464:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578112896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599791.653464:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578113024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599791.653472:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787599791.653472:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787599791.653488:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787599791.653494:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578112768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787599791.653508:0:25458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787599791.653515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578113024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787599791.653536:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578112768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599791.653541:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787599791.653542:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578112896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599791.653569:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578112768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599792.487166:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787599792.561048:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1787599792.734031:0:25543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787599793.519722:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599794.123153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123226:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599794.123430:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123840 00000100:00100000:1.0:1787599794.123439:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123840 00000100:00100000:1.0:1787599794.123491:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124352 00000100:00100000:1.0:1787599794.123495:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124352 00000100:00100000:1.0:1787599794.123510:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123968 00000100:00100000:1.0:1787599794.123513:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123968 00000100:00100000:1.0:1787599794.123525:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124480 00000100:00100000:1.0:1787599794.123527:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124480 00000100:00100000:1.0:1787599794.123543:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1787599794.123552:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+6:2406:x1874433559123840:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123641:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+6:2406:x1874433559123840:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 89us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123648:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:1.0:1787599794.123666:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599794.123673:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2406:x1874433559124352:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123695:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2406:x1874433559124352:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123701:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:1.0:1787599794.123721:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1787599794.123727:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559123968:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123748:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559123968:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123752:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:1.0:1787599794.123760:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599794.123764:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124480:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123779:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124480:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 14us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123812:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:1.0:1787599794.123834:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124096 00000100:00100000:1.0:1787599794.123837:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124096 00000100:00100000:1.0:1787599794.123857:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124608 00000100:00100000:1.0:1787599794.123860:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124608 00000100:00100000:1.0:1787599794.123872:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124224 00000100:00100000:1.0:1787599794.123874:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124224 00000100:00100000:1.0:1787599794.123885:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124736 00000100:00100000:1.0:1787599794.123887:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124736 00000100:00100000:1.0:1787599794.123899:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599794.123905:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559124096:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123924:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559124096:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123928:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599794.123935:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599794.123938:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124608:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123948:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124608:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 10us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123951:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599794.123956:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1787599794.123960:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559124224:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.123970:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+5:2406:x1874433559124224:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 10us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.123973:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:1.0:1787599794.123978:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1787599794.123987:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124736:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.124001:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2406:x1874433559124736:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 15us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.124005:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:1.0:1787599794.124021:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559123712 00000100:00100000:1.0:1787599794.124023:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559123712 00000100:00100000:1.0:1787599794.124040:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00100000:1.0:1787599794.124043:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2406:x1874433559123712:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599794.124055:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243554450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2406:x1874433559123712:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 12us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.124059:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 148 00000100:00080000:1.0:1787599794.124081:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787599794.124084:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787599794.124086:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787599794.124087:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599794.533621:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599794.729921:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599794.729944:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787599794.730015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599794.730087:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113152 00000100:00100000:1.0:1787599794.730094:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113152 00000100:00100000:1.0:1787599794.730149:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787599794.730158:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b244b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599794.730189:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599794.730233:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b244b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599794.730240:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787599794.730299:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599794.730334:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113152:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787599795.051646:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599795.239699:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578113280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599795.239783:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.239876:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578113792:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.239904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.239922:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578114304:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.239941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.239958:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578114816:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.239984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240007:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787599795.240013:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578113408:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240060:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578113920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240102:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578114432:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240203:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578114048:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578114560:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240301:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787599795.240306:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b244b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113664:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240343:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578114176:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240378:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578114688:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.240501:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113280 00000100:00100000:1.0:1787599795.240508:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113280 00000100:00100000:1.0:1787599795.240560:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599795.240569:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578113280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787599795.240597:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599795.240640:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578113280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.240647:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787599795.240703:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113792 00000100:00100000:1.0:1787599795.240707:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113792 00000100:00100000:1.0:1787599795.240726:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114304 00000100:00100000:1.0:1787599795.240728:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114304 00000100:00100000:1.0:1787599795.240737:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114816 00000100:00100000:1.0:1787599795.240739:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114816 00000100:00100000:1.0:1787599795.240751:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114432 00000100:00100000:1.0:1787599795.240753:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114432 00000100:00100000:1.0:1787599795.240764:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114560 00000100:00100000:1.0:1787599795.240766:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114560 00000100:00100000:1.0:1787599795.240775:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114688 00000100:00100000:1.0:1787599795.240777:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114688 00000100:00100000:1.0:1787599795.240811:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599795.240818:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240860:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874433578113792:12345-0@lo:400:kworker.0 Request processed in 42us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.240866:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599795.240879:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599795.240885:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578114304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240911:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874433578114304:12345-0@lo:400:kworker.0 Request processed in 26us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.240916:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599795.240927:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599795.240934:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578114816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.240960:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874433578114816:12345-0@lo:400:kworker.0 Request processed in 28us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.240966:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599795.240976:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599795.240982:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578114432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241024:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874433578114432:12345-0@lo:400:kworker.0 Request processed in 42us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241030:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787599795.241043:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599795.241050:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578114560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241082:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1874433578114560:12345-0@lo:400:kworker.0 Request processed in 33us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241087:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599795.241097:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599795.241103:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578114688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241135:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1874433578114688:12345-0@lo:400:kworker.0 Request processed in 33us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241140:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599795.241165:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113408 00000100:00100000:1.0:1787599795.241169:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113408 00000100:00100000:1.0:1787599795.241193:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787599795.241199:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3647:x1874433578113408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241226:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3647:x1874433578113408:12345-0@lo:400:kworker.0 Request processed in 27us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241232:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787599795.241276:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113920 00000100:00100000:1.0:1787599795.241280:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113920 00000100:00100000:1.0:1787599795.241299:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113536 00000100:00100000:1.0:1787599795.241301:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113536 00000100:00100000:1.0:1787599795.241311:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599795.241318:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241348:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578113920:12345-0@lo:400:kworker.0 Request processed in 31us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241354:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787599795.241364:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787599795.241370:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.241395:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113536:12345-0@lo:400:kworker.0 Request processed in 25us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.241400:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787599795.250290:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787599795.250301:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787599795.250304:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599795.250327:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114048 00000100:00100000:2.0:1787599795.250338:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114048 00000100:00100000:2.0:1787599795.250419:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578113664 00000100:00100000:2.0:1787599795.250422:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578113664 00000100:00100000:2.0:1787599795.250435:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114176 00000100:00100000:2.0:1787599795.250437:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114176 00000100:00100000:2.0:1787599795.250450:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599795.250456:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578114048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599795.250560:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578114048:12345-0@lo:400:kworker.0 Request processed in 104us (10335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599795.250566:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599795.250583:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599795.250587:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.251548:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599795.251636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599795.251699:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578114944 00000100:00100000:1.0:1787599795.251704:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578114944 00000100:00100000:1.0:1787599795.251739:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599795.251747:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578114944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787599795.251763:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787599795.251830:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874433578114944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599795.251837:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787599795.251882:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578114944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787599795.251913:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1874433578114688:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.251926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113536:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.251938:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578114048:0@lo:400:kworker.0 00010000:00080000:1.0:1787599795.251952:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d3b80 x1874433578114560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599795.251963:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1874433578114560:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.251994:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578113408:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.252006:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578113920:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.252017:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1874433578114432:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.252032:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578113280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787599795.252044:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874433578113792:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.252055:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874433578114304:0@lo:400:kworker.0 00010000:00080000:1.0:1787599795.252078:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b3811d0700 x1874433578114816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787599795.252088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b3811d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1874433578114816:0@lo:400:kworker.0 00000100:00100000:2.0:1787599795.252741:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578113664:12345-0@lo:400:kworker.0 Request processed in 2147us (12407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599795.252752:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787599795.253013:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787599795.253025:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578114176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599795.253062:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3811d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578114176:12345-0@lo:400:kworker.0 Request processed in 41us (12698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599795.253068:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787599795.253317:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b244b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578113664:0@lo:400:kworker.0 00000100:00100000:1.0:1787599795.253329:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578114176:0@lo:400:kworker.0 00000100:00080000:0.0:1787599795.256567:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787599795.256578:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787599795.559353:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599796.586184:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787599796.688391:0:25690:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeac7b2f60 20000000:00000080:3.0:1787599796.689168:0:25690:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96b3816ba400 uarg=0000000000000000 20000000:01000000:3.0:1787599796.689217:0:25690:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599796.689247:0:25690:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787599796.689252:0:25690:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787599796.695868:0:25691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787599796.696053:0:25690:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787599796.708369:0:25690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787599796.708495:0:25690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708515:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708538:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708545:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708552:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708560:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708566:0:25690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708573:0:25690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708617:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708633:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 12 pid: 22653 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.708648:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115072:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599796.708872:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708882:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.708898:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115200:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599796.708937:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.708945:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.708953:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115328:0@lo:104: 00000100:00100000:0.0:1787599796.708991:0:25690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599796.709032:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115328 00000100:00100000:0.0:1787599796.709040:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115328 00000100:00100000:0.0:1787599796.709094:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787599796.709103:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115328:12345-0@lo:104: 00010000:00010000:0.0:1787599796.709115:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.709160:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599796.709167:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115328:12345-0@lo:104: Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.709174:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787599796.709205:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.709213:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 23 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.709221:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115456:0@lo:104: 00000100:00100000:0.0:1787599796.709320:0:25690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599796.709340:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115456 00000100:00100000:0.0:1787599796.709343:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115456 00000100:00100000:0.0:1787599796.709362:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599796.709368:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115456:12345-0@lo:104: 00010000:00010000:0.0:1787599796.709375:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709741:0:24192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599796.709749:0:24192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709757:0:24192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b37b54b400 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599796.709761:0:24192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709770:0:24192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599796.709778:0:24192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599796.709810:0:24192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599796.709843:0:24192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709850:0:24192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599796.709870:0:24192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709878:0:24192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b37b54b400/0x5d2988b0929d1050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d1057 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.709892:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599796.709894:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599796.709895:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787599796.709968:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787599796.709976:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115456:12345-0@lo:104: Request processed in 607us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.709983:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787599796.710016:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.710025:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 23 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.710034:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115712:0@lo:104: 00000100:00100000:0.0:1787599796.710063:0:25690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787599796.710085:0:25690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 23 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.710093:0:25690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 23 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.710102:0:25690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115840:0@lo:104: 00000100:00100000:0.0:1787599796.710122:0:25690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599796.710143:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115712 00000100:00100000:0.0:1787599796.710152:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115712 00000100:00100000:0.0:1787599796.710169:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115840 00000100:00100000:0.0:1787599796.710171:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115840 00000100:00100000:0.0:1787599796.710183:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599796.710188:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:25690:x1874433578115712:12345-0@lo:104: 00010000:00010000:0.0:1787599796.710195:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.710393:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787599796.710409:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+4:25690:x1874433578115712:12345-0@lo:104: Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.710416:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599796.710432:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599796.710439:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115840:12345-0@lo:104: 00010000:00010000:0.0:1787599796.710447:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599796.710923:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578115584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599796.710958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599796.711007:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115584 00000100:00100000:1.0:1787599796.711012:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115584 00010000:00010000:1.0:1787599796.711033:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 24 pid: 22654 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599796.711057:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599796.711064:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578115584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787599796.711075:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599796.711080:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 24 pid: 22654 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599796.711090:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 24 pid: 22654 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599796.711108:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599796.711137:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3645:x1874433578115584:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599796.711144:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787599796.711179:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:559ac968-b0ab-4af8-8146-7f269e4a29a3:3645:1874433578115584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599796.711264:0:25690:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787599796.711280:0:25690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef6c600/0x5d2988b0929d1057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d1050 expref: 23 pid: 22654 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599796.711291:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115328:0@lo:104: 00000100:00100000:1.0:1787599796.711300:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115456:0@lo:104: 00000100:00100000:1.0:1787599796.711307:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115712:0@lo:104: 00000100:00100000:1.0:1787599796.711314:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115840:0@lo:104: 00010000:00010000:2.0:1787599796.715008:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787599796.715024:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715037:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3da00 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599796.715041:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715051:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599796.715057:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599796.715063:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599796.715140:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715148:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599796.715177:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715184:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3da00/0x5d2988b0929d0ecf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0ed6 expref: -99 pid: 24161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715200:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787599796.715204:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715209:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b24200d200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599796.715212:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.715218:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599796.715225:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599796.715985:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787599796.716060:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716067:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599796.716088:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716110:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b24200d200/0x5d2988b0929d0e90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e97 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716124:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787599796.716127:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716134:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d200 already unused, calling callback (ffffffffc114bc20) 10000000:00010000:2.0:1787599796.716137:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716144:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787599796.716150:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787599796.716155:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787599796.716250:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787599796.716267:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+3:25690:x1874433578115840:12345-0@lo:104: Request processed in 5822us (6137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.716277:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787599796.716906:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716916:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787599796.716925:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716932:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.101@tcp lock: ffff96b36ef3d200/0x5d2988b0929d0e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d2988b0929d0e89 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.716948:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599796.716958:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787599796.716960:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599796.716980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578115968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599796.717049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599796.717204:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578116096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599796.717549:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787599796.717767:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599796.717840:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578116224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787599796.717879:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599796.718172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599796.718217:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578115968 00000100:00100000:0.0:1787599796.718244:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578115968 00010000:00010000:0.0:1787599796.718280:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 23 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.718318:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116096 00000100:00100000:0.0:1787599796.718322:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116096 00010000:00010000:0.0:1787599796.718334:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 24 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.718366:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599796.718377:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3646:x1874433578115968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599796.718392:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599796.718398:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 24 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718409:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 24 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718427:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b3778b7400/0x5d2988b0929d0ed6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0ecf expref: 24 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718441:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599796.718724:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:3646:x1874433578115968:12345-0@lo:103:ldlm_bl.0 Request processed in 348us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.718732:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787599796.718750:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787599796.718758:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:3647:x1874433578116096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599796.718766:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599796.718770:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 22 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718779:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 22 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718789:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200ce00/0x5d2988b0929d0e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e90 expref: 22 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.718832:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599796.718860:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3647:x1874433578116096:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.718866:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787599796.719012:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:559ac968-b0ab-4af8-8146-7f269e4a29a3:3646:1874433578115968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787599796.719044:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370012300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:559ac968-b0ab-4af8-8146-7f269e4a29a3:3647:1874433578116096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599796.719571:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116224 00000100:00100000:1.0:1787599796.719577:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116224 00010000:00010000:1.0:1787599796.719604:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 21 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.719687:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787599796.719696:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:3648:x1874433578116224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787599796.719706:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599796.719711:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 21 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.719720:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 21 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.719732:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b24200cc00/0x5d2988b0929d0e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d2988b0929d0e82 expref: 21 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.719742:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599796.719981:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:3648:x1874433578116224:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.719989:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787599796.720109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b370010700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578116224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787599796.725713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599796.725786:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124864 00000100:00100000:0.0:1787599796.725809:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124864 00010000:00010000:0.0:1787599796.725845:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 13 pid: 22653 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599796.725887:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 13 00000100:00100000:0.0:1787599796.725897:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f919450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2403:x1874433559124864:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599796.725924:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599796.725930:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 13 pid: 22653 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.725942:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 13 pid: 22653 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599796.725960:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599796.726004:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f919450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2403:x1874433559124864:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599796.726011:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 13 00010000:00010000:3.0:1787599796.726727:0:25690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef6d600/0x5d2988b0929d11fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc132 expref: 12 pid: 22653 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599796.726745:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2436ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115072:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599796.726758:0:25690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433af100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25690:1874433578115200:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599796.726788:0:25690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599796.736692:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599796.736890:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559124992 00000100:00100000:2.0:1787599796.736900:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559124992 00010000:00010000:2.0:1787599796.736943:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599796.737020:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 14 00000100:00100000:2.0:1787599796.737031:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d15dc6-6015-48f9-a685-073cccef6f3e+12:2404:x1874433559124992:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599796.737055:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599796.737061:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737074:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737092:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef6c000/0x5d2988b0929d11bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0c2 expref: 12 pid: 22655 timeout: 843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737110:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737132:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737148:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737155:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737161:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737168:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737174:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:2.0:1787599796.737179:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737187:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737210:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599796.737221:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599796.737295:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29d15dc6-6015-48f9-a685-073cccef6f3e+11:2404:x1874433559124992:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 265us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599796.737302:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 14 00010000:00010000:3.0:1787599796.737879:0:25690:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599796.737889:0:25690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599796.737894:0:25690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96b36ef3d400/0x5d2988b0929d122c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599796.777651:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578116352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787599796.777731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599796.777979:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116352 00000100:00100000:1.0:1787599796.777987:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116352 00000100:00100000:1.0:1787599796.778055:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599796.778066:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578116352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787599796.778098:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599796.778143:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578116352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599796.778150:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787599796.778201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578116352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787599796.778226:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787599796.778232:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b366619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578116480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599796.778273:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599796.778309:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116480 00000100:00100000:1.0:1787599796.778313:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116480 00000100:00100000:1.0:1787599796.778338:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599796.778345:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578116480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787599796.778368:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599796.778400:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578116480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599796.778405:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787599796.778430:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b366619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578116480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599796.778675:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787599796.778686:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578116608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599796.778718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599796.779363:0:25458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116608 00000100:00100000:2.0:1787599796.779372:0:25458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116608 00000100:00100000:2.0:1787599796.779529:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599796.779540:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578116608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787599796.779569:0:25458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787599796.779627:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578116608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599796.779634:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787599796.779682:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578116608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787599797.606025:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787599798.249122:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787599798.249132:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b2443de800 from 13 10000000:01000000:1.0:1787599798.249138:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787599798.249194:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.249207:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.249219:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599798.249257:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b366619880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.249329:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599798.249385:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787599798.251209:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116736 00000100:00100000:2.0:1787599798.251237:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116736 00000100:00100000:2.0:1787599798.251320:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787599798.251331:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+20:22657:x1874433578116736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787599798.251347:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.251367:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef6d000/0x5d2988b0929d123a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d1233 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.251395:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef6d000/0x5d2988b0929d123a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d1233 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.251406:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef6d000/0x5d2988b0929d123a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d1233 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.251415:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6d000, rc 0) 00000100:00100000:2.0:1787599798.251509:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578116736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.251533:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787599798.251662:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b366619880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599798.251680:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d123a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.251689:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d123a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.251775:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.251844:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.251885:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599798.252204:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116864 00000100:00100000:0.0:1787599798.252210:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116864 00000100:00100000:0.0:1787599798.252265:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787599798.252275:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578116864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.252410:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578116864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.252417:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787599798.252549:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.252584:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.252626:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.252649:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.253069:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578116992 00000100:00100000:1.0:1787599798.253075:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578116992 00000100:00100000:1.0:1787599798.253107:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787599798.253114:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578116992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.253219:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578116992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.253250:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787599798.253697:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578116992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599798.255382:0:25704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599798.264286:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599798.264327:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599798.264342:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d123a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.264355:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b36e4de200/0x5d2988b0929d1233 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d123a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599798.264366:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599798.264369:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f892000 from 13 10000000:01000000:3.0:1787599798.264372:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599798.264414:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.264421:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.264432:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.265242:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.265318:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.265374:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.265609:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117120 00000100:00100000:1.0:1787599798.265618:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117120 00000100:00100000:1.0:1787599798.265676:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787599798.265687:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+21:22657:x1874433578117120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599798.265701:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599798.265717:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36e4de000/0x5d2988b0929d1248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d1241 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.265741:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36e4de000/0x5d2988b0929d1248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d1241 expref: 22 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.265752:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36e4de000/0x5d2988b0929d1248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d1241 expref: 22 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.265761:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36e4de000, rc 0) 00000100:00100000:1.0:1787599798.265829:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.265836:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787599798.266060:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599798.266089:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1248 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.266098:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d1248 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.266167:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.266196:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599798.275707:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117248 00000100:00100000:2.0:1787599798.275726:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117248 00000100:00100000:2.0:1787599798.275825:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787599798.275837:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787599798.276012:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (9815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.276020:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787599798.279499:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787599798.279543:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.279600:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.279684:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.279727:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599798.279861:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117376 00000100:00100000:0.0:1787599798.279869:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117376 00000100:00100000:0.0:1787599798.279927:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787599798.279938:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.280061:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.280086:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787599798.280551:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787599798.284128:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599798.284476:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599798.284504:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599798.284516:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1248 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.284527:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243759600/0x5d2988b0929d1241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1248 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599798.284555:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599798.284558:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b37f896800 from 13 10000000:01000000:3.0:1787599798.284561:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599798.284599:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.284607:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.284618:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.284644:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.284724:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.284759:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.284887:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117504 00000100:00100000:1.0:1787599798.284895:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117504 00000100:00100000:1.0:1787599798.284951:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787599798.284961:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+22:22657:x1874433578117504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599798.284973:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599798.284987:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36e4df400/0x5d2988b0929d1256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d124f expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.285010:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36e4df400/0x5d2988b0929d1256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d124f expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.285029:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36e4df400/0x5d2988b0929d1256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d124f expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.285038:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36e4df400, rc 0) 00000100:00100000:1.0:1787599798.285090:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.285097:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787599798.285727:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599798.285744:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1256 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.285754:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d1256 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.285850:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.285884:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.285908:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.286558:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117632 00000100:00100000:1.0:1787599798.286565:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117632 00000100:00100000:1.0:1787599798.286609:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787599798.286617:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.286739:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.286746:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787599798.286835:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.286870:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.286919:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.286954:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.287356:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117760 00000100:00100000:1.0:1787599798.287361:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117760 00000100:00100000:1.0:1787599798.287395:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787599798.287402:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.287488:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.287494:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787599798.287633:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599798.289464:0:25706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787599798.289676:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787599798.289696:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787599798.289707:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1256 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.289718:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758000/0x5d2988b0929d124f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1256 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787599798.289728:0:22657:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787599798.289730:0:22657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96b344b34800 from 13 10000000:01000000:3.0:1787599798.289733:0:22657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787599798.289766:0:22657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.289773:0:22657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.289783:0:22657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.289836:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.289890:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.289918:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.290072:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578117888 00000100:00100000:1.0:1787599798.290078:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578117888 00000100:00100000:1.0:1787599798.290121:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787599798.290130:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+23:22657:x1874433578117888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787599798.290152:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599798.290164:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36e4de400/0x5d2988b0929d1264 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d2988b0929d125d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.290184:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36e4de400/0x5d2988b0929d1264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d2988b0929d125d expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.290193:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36e4de400/0x5d2988b0929d1264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d2988b0929d125d expref: 24 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.290202:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36e4de400, rc 0) 00000100:00100000:1.0:1787599798.290680:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578117888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 549us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.290687:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787599798.290778:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578117888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599798.290825:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1264 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.290844:0:22657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d2988b0929d1264 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.290906:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578118016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.290935:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787599798.290960:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787599798.291015:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578118016 00000100:00100000:0.0:1787599798.291020:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578118016 00000100:00100000:0.0:1787599798.291055:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787599798.291070:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578118016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.291172:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578118016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.291178:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787599798.291434:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b37fa06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578118016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.291473:0:22657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b36661aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578118144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.291510:0:22657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599798.291537:0:22657:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3452ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1787599798.291643:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578118144 00000100:00100000:0.0:1787599798.291647:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578118144 00000100:00100000:0.0:1787599798.291679:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787599798.291686:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578118144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.291767:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:22657:x1874433578118144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.291773:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787599798.291881:0:22657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b36661aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:559ac968-b0ab-4af8-8146-7f269e4a29a3:22657:1874433578118144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787599798.294776:0:25707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787599798.303412:0:22657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787599798.303546:0:22657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.101@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787599798.303557:0:22657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1264 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.303567:0:22657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.101@tcp lock: ffff96b243758800/0x5d2988b0929d125d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d2988b0929d1264 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599798.388016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.388217:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125120 00000100:00100000:2.0:1787599798.388258:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125120 00000100:00100000:2.0:1787599798.388326:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:2.0:1787599798.388338:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+6:18693:x1874433559125120:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599798.388358:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.388380:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d126b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc16a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388442:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388467:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388482:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388512:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388520:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388526:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388606:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c000/0x5d2988b0929d1280 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388614:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c000/0x5d2988b0929d1280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388621:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c000/0x5d2988b0929d1280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.388649:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599798.388653:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599798.388691:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c000/0x5d2988b0929d1280 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388702:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388708:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.388715:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389265:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.389270:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389277:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389290:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:2.0:1787599798.389293:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.389297:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389302:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389316:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389322:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389327:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389332:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.389335:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389341:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389360:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.389363:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.389365:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389371:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d1279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389408:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d126b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc16a expref: 8 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389422:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c000/0x5d2988b0929d1280 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc16a expref: 7 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.389429:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b343b14500) 00010000:00010000:2.0:1787599798.389431:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599798.389433:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6c000, rc 0) 00000100:00080000:0.0:1787599798.389547:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599798.390012:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+7:18693:x1874433559125120:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 1675us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.390021:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 23 00000100:00100000:1.0:1787599798.407098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.411986:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125248 00000100:00100000:0.0:1787599798.412003:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125248 00000100:00100000:0.0:1787599798.412365:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:0.0:1787599798.412378:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07a4010e-4a97-45be-a56f-11284301c754+7:18693:x1874433559125248:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787599798.412487:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07a4010e-4a97-45be-a56f-11284301c754+7:18693:x1874433559125248:12345-192.168.202.1@tcp:900:lhsmtool_posix.0 Request processed in 112us (5398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.412496:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:1.0:1787599798.417780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.418052:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125504 00000100:00100000:2.0:1787599798.418062:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125504 00000100:00100000:2.0:1787599798.418123:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:2.0:1787599798.418134:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+7:18693:x1874433559125504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787599798.418155:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.418176:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d1287 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc171 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418282:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418295:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418307:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418322:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418330:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418336:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418455:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d600/0x5d2988b0929d129c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418464:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d600/0x5d2988b0929d129c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418471:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d600/0x5d2988b0929d129c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.418481:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787599798.418928:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418947:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418954:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418960:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.418965:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418971:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418983:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96b343b14500) 00010000:00010000:2.0:1787599798.418986:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.418990:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.418996:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d128e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419010:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419016:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419084:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419090:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.419099:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419106:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419115:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.419118:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.419121:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.419127:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d1295 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.424652:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d1287 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc171 expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.424682:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d600/0x5d2988b0929d129c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc171 expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.424692:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b343b14d00) 00010000:00010000:2.0:1787599798.424696:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.424700:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6d600, rc 0) 00000100:00100000:2.0:1787599798.424785:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+9:18693:x1874433559125504:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 6651us (7013us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787599798.424813:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 24 00000100:00100000:1.0:1787599798.430293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.430396:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125632 00000100:00100000:2.0:1787599798.430407:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125632 00000100:00100000:2.0:1787599798.430535:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599798.430547:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+9:18693:x1874433559125632:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787599798.430742:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+9:18693:x1874433559125632:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 196us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.430750:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:3.0:1787599798.435619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599798.435725:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125760 00000100:00100000:1.0:1787599798.435736:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125760 00000100:00100000:1.0:1787599798.435847:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1787599798.435859:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+5:18693:x1874433559125760:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787599798.436145:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1787599798.440823:0:24662:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4920us 00000100:00100000:1.0:1787599798.461160:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+5:18693:x1874433559125760:12345-192.168.202.1@tcp:59:lhsmtool_posix.0 Request processed in 25289us (25542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.461178:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:1.0:1787599798.492907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.493058:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559125888 00000100:00100000:2.0:1787599798.493069:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559125888 00000100:00100000:2.0:1787599798.493146:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:2.0:1787599798.493156:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+9:18699:x1874433559125888:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599798.493179:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.493200:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc178 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493280:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493294:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493305:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493363:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493371:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493378:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493429:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493445:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493451:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493458:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.493462:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493468:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493481:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:2.0:1787599798.493484:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.493488:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493493:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493508:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493514:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493519:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493525:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.493533:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493539:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493547:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.493550:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.493552:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493558:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493592:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc178 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493601:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:2.0:1787599798.493603:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.493607:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc178 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.493616:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6c200, rc 0) 00000100:00100000:2.0:1787599798.493689:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+9:18699:x1874433559125888:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 534us (791us total) trans 0 rc 301/301 00000100:00100000:2.0:1787599798.493696:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 27 00000100:00100000:3.0:1787599798.497649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.497761:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126016 00000100:00100000:2.0:1787599798.497771:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126016 00000100:00100000:2.0:1787599798.497863:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1787599798.497877:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07a4010e-4a97-45be-a56f-11284301c754+9:18699:x1874433559126016:12345-192.168.202.1@tcp:700:lfs.0 00000100:00100000:2.0:1787599798.497985:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07a4010e-4a97-45be-a56f-11284301c754+9:18699:x1874433559126016:12345-192.168.202.1@tcp:700:lfs.0 Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.497994:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1787599798.500508:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.500600:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126272 00000100:00100000:2.0:1787599798.500610:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126272 00000100:00100000:2.0:1787599798.500669:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1787599798.500678:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+9:18699:x1874433559126272:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:2.0:1787599798.500731:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599798.500758:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b37b54ae00/0x5d2988b0929d11e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc0f3 expref: 9 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.500779:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:2.0:1787599798.500784:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787599798.500871:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.500886:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 5 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.500894:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.500929:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 5 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.500943:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 5 pid: 24662 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599798.500975:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578118272:192.168.202.1@tcp:104: 00000100:00100000:2.0:1787599798.501242:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b37b61d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787599798.510443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599798.511196:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126400 00000100:00100000:3.0:1787599798.511207:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126400 00010000:00010000:3.0:1787599798.511282:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 6 pid: 24662 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599798.511325:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:3.0:1787599798.511335:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2404:x1874433559126400:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787599798.511349:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787599798.511356:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 6 pid: 24662 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.511369:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 6 pid: 24662 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.511400:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:3.0:1787599798.511405:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.511431:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.511439:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.511458:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787599798.511518:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a33c25-965c-43ee-9328-e2b907b291c8+6:2404:x1874433559126400:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 184us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599798.511525:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00080000:0.0:1787599798.511815:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787599798.513237:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3c800/0x5d2988b0929d1225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc163 expref: 5 pid: 24662 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599798.513261:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578118272:192.168.202.1@tcp:104: 00010000:00010000:2.0:1787599798.513296:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.513306:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.513312:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.513342:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.513352:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.513360:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515875:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515899:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515918:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599798.515937:0:22662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8fbbc5 reply state 000000004a942568 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515950:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515958:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:2.0:1787599798.515962:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599798.515966:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787599798.515973:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787599798.515981:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515988:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.515996:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516003:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c600 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.516007:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516015:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516025:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158900) 00010000:00010000:2.0:1787599798.516028:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.516038:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516045:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c600/0x5d2988b0929d12bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787599798.516067:0:22662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8fbbc5 reply state 000000004a942568 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516077:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.516083:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.516193:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787599798.516195:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787599798.516307:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+10:18699:x1874433559126272:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 15624us (15805us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787599798.516316:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1787599798.537092:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.537640:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126528 00000100:00100000:0.0:1787599798.537651:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126528 00000100:00100000:0.0:1787599798.537713:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:0.0:1787599798.537723:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+11:18073:x1874433559126528:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787599798.537741:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599798.537762:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b36ef3c800/0x5d2988b0929d12d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc17f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.537843:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b36ef3c800/0x5d2988b0929d12d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc17f expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.537857:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b36ef3c800/0x5d2988b0929d12d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc17f expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.537866:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3c800, rc 0) 00000100:00100000:0.0:1787599798.538056:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126528:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 332us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.538064:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 162 00000100:00100000:1.0:1787599798.541373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.541703:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126656 00000100:00100000:0.0:1787599798.541715:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126656 00000100:00100000:0.0:1787599798.541777:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:0.0:1787599798.541840:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126656:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.542062:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b379ca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126656:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 224us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.542070:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 163 00000100:00100000:3.0:1787599798.553484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.557502:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126784 00000100:00100000:0.0:1787599798.557520:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126784 00000100:00100000:0.0:1787599798.557602:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:0.0:1787599798.557612:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126784:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787599798.557757:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126784:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 147us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.557763:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 164 00000100:00100000:1.0:1787599798.562757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599798.562881:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559126912 00000100:00100000:3.0:1787599798.562892:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559126912 00000100:00100000:3.0:1787599798.562953:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1787599798.562964:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+12:18073:x1874433559126912:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787599798.562981:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599798.562999:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96b243759e00/0x5d2988b0929d12db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc186 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.563023:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96b243759e00/0x5d2988b0929d12db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc186 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.563034:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96b243759e00/0x5d2988b0929d12db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc186 expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.563043:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759e00, rc 0) 00000100:00100000:3.0:1787599798.563193:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18073:x1874433559126912:12345-192.168.202.1@tcp:101:ll_cfg_requeue.0 Request processed in 230us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599798.563215:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 165 00000100:00100000:3.0:1787599798.565442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599798.565604:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127040 00000100:00100000:1.0:1787599798.565612:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127040 00000100:00100000:1.0:1787599798.565693:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1787599798.565701:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18073:x1874433559127040:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787599798.565865:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18073:x1874433559127040:12345-192.168.202.1@tcp:501:ll_cfg_requeue.0 Request processed in 164us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.565873:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 166 00000100:00100000:1.0:1787599798.568013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599798.568100:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127168 00000100:00100000:3.0:1787599798.568110:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127168 00000100:00100000:3.0:1787599798.568157:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 167 00000100:00100000:3.0:1787599798.568164:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18073:x1874433559127168:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787599798.568310:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:29d15dc6-6015-48f9-a685-073cccef6f3e+13:18073:x1874433559127168:12345-192.168.202.1@tcp:503:ll_cfg_requeue.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599798.568318:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 167 00010000:00010000:3.0:1787599798.629168:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787599798.663448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599798.664137:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127296 00000100:00100000:1.0:1787599798.664149:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127296 00000100:00100000:1.0:1787599798.664324:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:1.0:1787599798.664336:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+10:18709:x1874433559127296:12345-192.168.202.1@tcp:101:lctl.0 00010000:00010000:1.0:1787599798.664360:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599798.664395:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d12e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc18d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664462:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfe00/0x5d2988b0929d12e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664497:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfe00/0x5d2988b0929d12e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664509:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfe00/0x5d2988b0929d12e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787599798.664553:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787599798.664557:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787599798.664595:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfe00/0x5d2988b0929d12e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664619:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d12e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc18d expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664640:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfe00/0x5d2988b0929d12e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc18d expref: 11 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599798.664648:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:1.0:1787599798.664651:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787599798.664654:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36e4dfe00, rc 0) 00000100:00100000:1.0:1787599798.664721:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+11:18709:x1874433559127296:12345-192.168.202.1@tcp:101:lctl.0 Request processed in 387us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599798.664728:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000040:00080000:1.0:1787599798.695044:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599798.725493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.733064:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127424 00000100:00100000:2.0:1787599798.733083:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127424 00000100:00100000:2.0:1787599798.733172:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:2.0:1787599798.733193:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+5:18710:x1874433559127424:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599798.733212:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.733262:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc194 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733329:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c800/0x5d2988b0929d12f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733342:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c800/0x5d2988b0929d12f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733366:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c800/0x5d2988b0929d12f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.733422:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599798.733427:0:24662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599798.733447:0:24662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c800/0x5d2988b0929d12f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733473:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d12f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc194 expref: 7 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733493:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c800/0x5d2988b0929d12f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc194 expref: 6 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.733502:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.733505:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599798.733509:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6c800, rc 0) 00000100:00100000:2.0:1787599798.733586:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18710:x1874433559127424:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 404us (8104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.733594:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:3.0:1787599798.738306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.738391:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127552 00000100:00100000:2.0:1787599798.738402:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127552 00000100:00100000:2.0:1787599798.738462:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:2.0:1787599798.738473:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+6:18710:x1874433559127552:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599798.738495:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.738515:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d12fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc19b expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.738600:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.738616:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.738627:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739030:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739038:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739044:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739118:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739126:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739134:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.739170:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599798.739174:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599798.739320:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739346:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739352:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739359:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739364:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6da00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.739369:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739376:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739400:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.739403:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.739408:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739414:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739426:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739431:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739437:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739448:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.739452:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739458:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739466:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.739469:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.739471:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739476:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d800/0x5d2988b0929d130c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739504:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d12fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc19b expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739518:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc19b expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.739524:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:2.0:1787599798.739527:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787599798.739529:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6d400, rc 0) 00000100:00100000:2.0:1787599798.739602:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+7:18710:x1874433559127552:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 1129us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.739610:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1787599798.753704:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.754783:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127680 00000100:00100000:2.0:1787599798.754856:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127680 00000100:00100000:2.0:1787599798.754940:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:2.0:1787599798.754950:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:18710:x1874433559127680:12345-192.168.202.1@tcp:900:lfs.0 00000100:00100000:2.0:1787599798.755042:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a0a33c25-965c-43ee-9328-e2b907b291c8+5:18710:x1874433559127680:12345-192.168.202.1@tcp:900:lfs.0 Request processed in 93us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.755050:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00080000:0.0:1787599798.755649:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787599798.763071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.764956:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559127936 00000100:00100000:2.0:1787599798.764973:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559127936 00000100:00100000:2.0:1787599798.765103:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:2.0:1787599798.765114:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+7:18710:x1874433559127936:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599798.765135:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.765155:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d131a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1a2 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.765279:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787599798.765377:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d131a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1a2 expref: 9 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.765404:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.765408:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599798.765413:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d131a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1a2 expref: 9 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.765428:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6dc00, rc 0) 00000100:00100000:2.0:1787599798.765558:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+8:18710:x1874433559127936:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 445us (2495us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787599798.765565:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 32 00000100:00100000:3.0:1787599798.769972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.770147:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559128192 00000100:00100000:0.0:1787599798.770158:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559128192 00000100:00100000:0.0:1787599798.770234:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:0.0:1787599798.770245:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+8:18710:x1874433559128192:12345-192.168.202.1@tcp:36:lfs.0 00010000:00010000:0.0:1787599798.770302:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599798.770330:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d400/0x5d2988b0929d1313 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc19b expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.770349:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599798.770354:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599798.770377:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.770401:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.770426:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599798.770621:0:22659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000220368cb reply state 0000000000d4616d transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.770634:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.770640:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599798.770643:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787599798.770646:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787599798.770653:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787599798.770735:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+9:18710:x1874433559128192:12345-192.168.202.1@tcp:36:lfs.0 Request processed in 491us (773us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787599798.770742:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 33 00000100:00100000:3.0:1787599798.775448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.775590:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559128448 00000100:00100000:0.0:1787599798.775601:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559128448 00000100:00100000:0.0:1787599798.775665:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1787599798.775676:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+9:18710:x1874433559128448:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599798.776128:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+10:18710:x1874433559128448:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 453us (691us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787599798.776137:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1787599798.779519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.779606:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559128704 00000100:00100000:2.0:1787599798.779619:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559128704 00000100:00100000:2.0:1787599798.779677:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:2.0:1787599798.779732:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0a33c25-965c-43ee-9328-e2b907b291c8+10:18710:x1874433559128704:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:2.0:1787599798.779768:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.779831:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d132f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1a9 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779912:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779925:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779936:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779946:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779953:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.779959:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.780057:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787599798.780132:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780139:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780162:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780169:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.780173:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780181:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780193:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.780197:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.780201:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780208:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780233:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780240:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780246:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780250:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.780253:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780269:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780277:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.780280:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.780283:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780289:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d133d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780324:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d132f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1a9 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780335:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.780337:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787599798.780341:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d132f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1a9 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.780350:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6da00, rc 0) 00000100:00100000:2.0:1787599798.780421:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a0a33c25-965c-43ee-9328-e2b907b291c8+11:18710:x1874433559128704:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 734us (912us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787599798.780428:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 34 00000100:00100000:3.0:1787599798.783572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.783674:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559128832 00000100:00100000:0.0:1787599798.783685:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559128832 00000100:00100000:0.0:1787599798.783753:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:0.0:1787599798.783764:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+11:18710:x1874433559128832:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599798.783848:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599798.783868:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d134b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1b0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.783958:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.783972:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.783983:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599798.784011:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787599798.784015:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599798.784034:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.784061:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d134b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 13 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.784078:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.784087:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599798.784090:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787599798.784094:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef3ce00, rc 0) 00000100:00100000:0.0:1787599798.784148:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+12:18710:x1874433559128832:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 386us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.784154:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 35 00000100:00100000:3.0:1787599798.792539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.792727:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559128960 00000100:00100000:0.0:1787599798.792744:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559128960 00000100:00100000:0.0:1787599798.792848:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:0.0:1787599798.792859:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+12:18710:x1874433559128960:12345-192.168.202.1@tcp:37:lfs.0 00000100:00100000:0.0:1787599798.801233:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+12:18710:x1874433559128960:12345-192.168.202.1@tcp:37:lfs.0 Request processed in 8355us (8705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599798.801247:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 3 00000100:00100000:3.0:1787599798.810246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599798.810355:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129216 00000100:00100000:1.0:1787599798.810366:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129216 00000100:00100000:1.0:1787599798.810451:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:1.0:1787599798.810461:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34425dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+12:18710:x1874433559129216:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:1.0:1787599798.810707:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34425dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+13:18710:x1874433559129216:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 247us (473us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787599798.810714:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 4 00000100:00100000:3.0:1787599798.894962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.895096:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129344 00000100:00100000:2.0:1787599798.895108:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129344 00000100:00100000:2.0:1787599798.895170:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:2.0:1787599798.895181:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+11:18716:x1874433559129344:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:2.0:1787599798.895227:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599798.895248:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1b7 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895317:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895332:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895344:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895355:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895361:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895367:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895455:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d136e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895464:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d136e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895471:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d136e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787599798.895503:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787599798.895513:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787599798.895551:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d136e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895564:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895570:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895577:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895583:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6cc00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.895588:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895594:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895606:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:2.0:1787599798.895609:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.895614:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895620:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d1360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895633:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895639:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895655:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895660:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ce00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:2.0:1787599798.895663:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895669:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895677:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:2.0:1787599798.895680:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787599798.895683:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895689:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ce00/0x5d2988b0929d1367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895714:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6da00/0x5d2988b0929d1359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b7 expref: 13 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895726:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6dc00/0x5d2988b0929d136e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b7 expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.895732:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:2.0:1787599798.895734:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787599798.895737:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6dc00, rc 0) 00000100:00100000:2.0:1787599798.895855:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+12:18716:x1874433559129344:12345-192.168.202.1@tcp:101:bash.0 Request processed in 675us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.895871:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 36 00000100:00100000:3.0:1787599798.899918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.900248:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129472 00000100:00100000:2.0:1787599798.900259:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129472 00000100:00100000:2.0:1787599798.900324:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599798.900334:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a4010e-4a97-45be-a56f-11284301c754+5:18716:x1874433559129472:12345-192.168.202.1@tcp:900:bash.0 00000100:00100000:2.0:1787599798.900431:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37fa04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07a4010e-4a97-45be-a56f-11284301c754+5:18716:x1874433559129472:12345-192.168.202.1@tcp:900:bash.0 Request processed in 97us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.900438:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:3.0:1787599798.904691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599798.904823:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129728 00000100:00100000:0.0:1787599798.904833:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129728 00000100:00100000:0.0:1787599798.904892:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:0.0:1787599798.904902:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+12:18716:x1874433559129728:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:0.0:1787599798.904922:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599798.904943:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d1375 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1be expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.905045:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.905060:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.905069:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.905116:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.905130:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 12 pid: 22661 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599798.905156:0:22661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22661:1874433578118400:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599798.905254:0:22661:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787599798.908499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.909403:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129856 00000100:00100000:2.0:1787599798.909415:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129856 00010000:00010000:2.0:1787599798.909468:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 13 pid: 22661 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599798.909509:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599798.909520:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+13:2404:x1874433559129856:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599798.909535:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599798.909542:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 13 pid: 22661 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.909557:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 13 pid: 22661 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.909580:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:2.0:1787599798.909585:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.909613:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.909620:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599798.909639:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599798.909839:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0a33c25-965c-43ee-9328-e2b907b291c8+13:2404:x1874433559129856:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 320us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599798.909848:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00010000:00010000:0.0:1787599798.910367:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ce00/0x5d2988b0929d1352 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1b0 expref: 12 pid: 22661 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599798.910385:0:22661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22661:1874433578118400:192.168.202.1@tcp:104: 00010000:00010000:0.0:1787599798.910415:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.910423:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.910430:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.910503:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.910514:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.910522:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911022:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911032:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911049:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599798.911061:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599798.911350:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911359:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911366:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911371:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599798.911375:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911395:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911407:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599798.911410:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599798.911414:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911419:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3ca00/0x5d2988b0929d137c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599798.911431:0:22661:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067efaabd reply state 00000000e50cceb2 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911452:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911458:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96b34de5f900) 00010000:00010000:0.0:1787599798.911461:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599798.911464:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787599798.911502:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3da00/0x5d2988b0929d1375 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 15 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911515:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 14 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599798.911523:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599798.911524:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787599798.911527:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7400, rc 0) 00000100:00100000:0.0:1787599798.911576:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+15:18716:x1874433559129728:12345-192.168.202.1@tcp:101:bash.0 Request processed in 6674us (6895us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787599798.911584:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 37 00000100:00100000:1.0:1787599798.942940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.946433:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559129984 00000100:00100000:2.0:1787599798.946450:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559129984 00000100:00100000:3.0:1787599798.947101:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:3.0:1787599798.947114:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+15:18716:x1874433559129984:12345-192.168.202.1@tcp:101:bash.0 00010000:00010000:3.0:1787599798.947138:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599798.947176:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d1398 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1c5 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947260:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947273:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947284:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599798.947329:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787599798.947333:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787599798.947351:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947361:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947384:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d1398 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 17 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947416:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 16 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599798.947425:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:3.0:1787599798.947428:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787599798.947431:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243758e00, rc 0) 00000100:00100000:3.0:1787599798.947788:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+16:18716:x1874433559129984:12345-192.168.202.1@tcp:101:bash.0 Request processed in 663us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599798.948096:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 38 00000100:00100000:1.0:1787599798.959016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599798.959194:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559130240 00000100:00100000:2.0:1787599798.959205:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559130240 00000100:00100000:2.0:1787599798.959279:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 5 00000100:00100000:2.0:1787599798.959290:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a4010e-4a97-45be-a56f-11284301c754+16:18716:x1874433559130240:12345-192.168.202.1@tcp:35:bash.0 00000001:00080000:2.0:1787599798.959495:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1787599798.959614:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a4010e-4a97-45be-a56f-11284301c754+18:18716:x1874433559130240:12345-192.168.202.1@tcp:35:bash.0 Request processed in 325us (606us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1787599798.959622:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 5 00000020:00080000:2.0:1787599798.959627:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787599799.127064:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599799.127161:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559130496 00000100:00100000:3.0:1787599799.127176:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559130496 00000100:00100000:3.0:1787599799.127255:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:3.0:1787599799.127267:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+18:18726:x1874433559130496:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:3.0:1787599799.127293:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599799.127313:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1cc expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599799.127423:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787599799.127527:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1cc expref: 20 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.127558:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96b242158b00) 00010000:00010000:3.0:1787599799.127561:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599799.127567:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1cc expref: 20 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.127593:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:3.0:1787599799.127650:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+19:18726:x1874433559130496:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 385us (596us total) trans 12884901899 rc 301/301 00000100:00100000:3.0:1787599799.127657:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 39 00000100:00100000:1.0:1787599799.137207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.137335:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559130752 00000100:00100000:0.0:1787599799.137347:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559130752 00000100:00100000:0.0:1787599799.137417:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 6 00000100:00100000:0.0:1787599799.137429:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+19:18726:x1874433559130752:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599799.137663:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+20:18726:x1874433559130752:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 235us (465us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1787599799.137670:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 6 00000040:00080000:0.0:1787599799.143192:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787599799.217207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.217331:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131008 00000100:00100000:0.0:1787599799.217342:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131008 00000100:00100000:0.0:1787599799.217402:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:0.0:1787599799.217414:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+20:18729:x1874433559131008:12345-192.168.202.1@tcp:101:lfs.0 00010000:00010000:0.0:1787599799.217437:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599799.217458:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d13b4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1d3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.217559:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6600/0x5d2988b0929d13bb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.217573:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6600/0x5d2988b0929d13bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.217584:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6600/0x5d2988b0929d13bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599799.217595:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599799.217693:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d13b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1d3 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.217711:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6600/0x5d2988b0929d13bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1d3 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.217720:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.217723:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599799.217727:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6600, rc 0) 00000100:00100000:0.0:1787599799.217852:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+22:18729:x1874433559131008:12345-192.168.202.1@tcp:101:lfs.0 Request processed in 440us (655us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787599799.217876:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 40 00000100:00100000:2.0:1787599799.222820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.222862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599799.223241:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131136 00000100:00100000:3.0:1787599799.223253:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131136 00000100:00100000:3.0:1787599799.223329:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:3.0:1787599799.223340:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+22:18729:x1874433559131136:12345-192.168.202.1@tcp:54:lfs.0 00010000:00010000:3.0:1787599799.223421:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223437:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223449:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223486:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223492:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223500:0:24662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223506:0:24662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243759000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599799.223511:0:24662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223518:0:24662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223529:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:3.0:1787599799.223532:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787599799.223536:0:24662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.223542:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13c9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599799.223649:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+22:18729:x1874433559131136:12345-192.168.202.1@tcp:54:lfs.0 Request processed in 311us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599799.223657:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 41 00000100:00100000:1.0:1787599799.225447:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131264 00000100:00100000:1.0:1787599799.225460:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131264 00000100:00100000:1.0:1787599799.225532:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:1.0:1787599799.225559:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+22:2403:x1874433559131264:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599799.225582:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599799.225605:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6600/0x5d2988b0929d13bb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1d3 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.225623:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:1.0:1787599799.225627:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599799.225688:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+21:2403:x1874433559131264:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 146us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599799.225695:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:2.0:1787599799.229377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.229471:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131520 00000100:00100000:0.0:1787599799.229482:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131520 00000100:00100000:0.0:1787599799.229537:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:0.0:1787599799.229549:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+21:18729:x1874433559131520:12345-192.168.202.1@tcp:35:lfs.0 00000100:00100000:0.0:1787599799.229788:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+22:18729:x1874433559131520:12345-192.168.202.1@tcp:35:lfs.0 Request processed in 240us (420us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787599799.229831:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 7 00000100:00100000:2.0:1787599799.270900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.270957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.270989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.270991:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131776 00000100:00100000:0.0:1787599799.271003:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131776 00000100:00100000:2.0:1787599799.271039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.271056:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132288 00000100:00100000:0.0:1787599799.271059:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132288 00000100:00100000:2.0:1787599799.271066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.271081:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1787599799.271083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.271091:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+22:2404:x1874433559131776:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.271110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.271125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.271145:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132032 00000100:00100000:2.0:1787599799.271149:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132032 00000100:00100000:0.0:1787599799.271168:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+22:2404:x1874433559131776:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 79us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.271175:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:2.0:1787599799.271180:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132544 00000100:00100000:2.0:1787599799.271183:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132544 00000100:00100000:0.0:1787599799.271188:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131904 00000100:00100000:0.0:1787599799.271191:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131904 00000100:00100000:2.0:1787599799.271194:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132160 00000100:00100000:2.0:1787599799.271195:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132160 00000100:00100000:0.0:1787599799.271201:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132416 00000100:00100000:0.0:1787599799.271203:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132416 00000100:00100000:2.0:1787599799.271207:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132672 00000100:00100000:2.0:1787599799.271209:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132672 00000100:00100000:0.0:1787599799.271226:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1787599799.271232:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+12:2404:x1874433559132288:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271255:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1787599799.271258:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+12:2404:x1874433559132288:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599799.271262:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3815d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559132032:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599799.271264:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1787599799.271281:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:2.0:1787599799.271286:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3815d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559132032:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.271287:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559131904:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271293:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 15 00000100:00100000:0.0:1787599799.271333:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559131904:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.271339:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:0.0:1787599799.271348:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:0.0:1787599799.271354:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132416:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:0.0:1787599799.271373:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132416:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 20us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.271387:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599799.271433:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599799.271440:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132544:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271462:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132544:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599799.271468:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 16 00000100:00100000:2.0:1787599799.271480:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599799.271486:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559132160:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271510:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559132160:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599799.271521:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599799.271533:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:2.0:1787599799.271540:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132672:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:2.0:1787599799.271563:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a0a33c25-965c-43ee-9328-e2b907b291c8+5:2404:x1874433559132672:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599799.271568:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00080000:2.0:1787599799.271589:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787599799.271593:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787599799.272503:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559131648 00000100:00100000:1.0:1787599799.272511:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559131648 00000100:00100000:1.0:1787599799.272579:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 168 00000100:00100000:1.0:1787599799.272589:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2404:x1874433559131648:12345-192.168.202.1@tcp:400:kworker.0 00000100:00100000:1.0:1787599799.272633:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:29d15dc6-6015-48f9-a685-073cccef6f3e+13:2404:x1874433559131648:12345-192.168.202.1@tcp:400:kworker.0 Request processed in 46us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599799.272640:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 168 00010000:00010000:3.0:1787599799.653007:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599799.691053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.691164:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559132928 00000100:00100000:0.0:1787599799.691174:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559132928 00000100:00100000:0.0:1787599799.691264:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:0.0:1787599799.691276:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+22:18760:x1874433559132928:12345-192.168.202.1@tcp:101:cat.0 00010000:00010000:0.0:1787599799.691295:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599799.691315:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d13d0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1da expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.691429:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.691443:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.691454:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599799.691483:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599799.691604:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d13d0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1da expref: 25 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.691623:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1da expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.691632:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.691634:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599799.691638:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6400, rc 0) 00000100:00100000:0.0:1787599799.691715:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+24:18760:x1874433559132928:12345-192.168.202.1@tcp:101:cat.0 Request processed in 442us (672us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1787599799.691723:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 42 00000100:00100000:2.0:1787599799.699225:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599799.699274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599799.699532:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133312 00000100:00100000:1.0:1787599799.699543:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133312 00000100:00100000:1.0:1787599799.699606:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599799.699617:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+24:18760:x1874433559133312:12345-192.168.202.1@tcp:35:cat.0 00000100:00100000:0.0:1787599799.699942:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133056 00000100:00100000:0.0:1787599799.699947:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133056 00000100:00100000:0.0:1787599799.699998:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:0.0:1787599799.700005:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+26:2404:x1874433559133056:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599799.700018:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599799.700044:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1da expref: 26 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.700064:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.700069:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599799.700704:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+25:2404:x1874433559133056:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 695us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.700713:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:1.0:1787599799.707826:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+24:18760:x1874433559133312:12345-192.168.202.1@tcp:35:cat.0 Request processed in 8178us (8517us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787599799.707842:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 8 00000100:00100000:1.0:1787599799.800787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599799.800934:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133568 00000100:00100000:3.0:1787599799.800948:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133568 00000100:00100000:3.0:1787599799.801017:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:3.0:1787599799.801029:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b36661aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+24:18766:x1874433559133568:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:3.0:1787599799.801062:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787599799.801085:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d13e5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1e1 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801248:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801265:0:24662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801275:0:24662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 25 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801284:0:24662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801325:0:24662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 25 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801409:0:24662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 25 pid: 22662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599799.801426:0:24662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24662:1874433578118528:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599799.801549:0:24662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.801560:0:24662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 25 pid: 22661 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599799.801569:0:24662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24662:1874433578118656:192.168.202.1@tcp:104: 00000100:00100000:3.0:1787599799.801598:0:24662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24349bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599799.807779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599799.808120:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133696 00000100:00100000:1.0:1787599799.808130:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133696 00010000:00010000:1.0:1787599799.808168:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 26 pid: 22662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599799.808380:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:1.0:1787599799.808391:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07a4010e-4a97-45be-a56f-11284301c754+26:2403:x1874433559133696:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599799.808406:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599799.808412:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 26 pid: 22662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.808426:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 26 pid: 22662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.808449:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:1.0:1787599799.808467:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.808476:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.808482:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599799.808540:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07a4010e-4a97-45be-a56f-11284301c754+26:2403:x1874433559133696:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 151us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599799.808548:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 17 00000100:00100000:2.0:1787599799.808844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.809103:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133824 00000100:00100000:0.0:1787599799.809111:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133824 00010000:00010000:0.0:1787599799.809135:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 26 pid: 22661 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599799.809169:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 18 00000100:00100000:0.0:1787599799.809177:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37f919050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+26:2403:x1874433559133824:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787599799.809186:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599799.809191:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 26 pid: 22661 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.809201:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 26 pid: 22661 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.809228:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.809232:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.809241:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.809248:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.809267:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599799.809293:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37f919050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+26:2403:x1874433559133824:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 117us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.809300:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 18 00010000:00010000:3.0:1787599799.809616:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d139f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1c5 expref: 25 pid: 22662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599799.809646:0:24662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24662:1874433578118528:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599799.809660:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7400/0x5d2988b0929d138a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1be expref: 24 pid: 22661 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599799.809670:0:24662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2433ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24662:1874433578118656:192.168.202.1@tcp:104: 00010000:00010000:3.0:1787599799.809688:0:24662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.809697:0:24662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.809715:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787599799.811762:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787599799.811958:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759c00/0x5d2988b0929d13e5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e1 expref: 25 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.811993:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243759000/0x5d2988b0929d13ec lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e1 expref: 24 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.812002:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:3.0:1787599799.812005:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787599799.812008:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b243759000, rc 0) 00000100:00100000:3.0:1787599799.812062:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b36661aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+24:18766:x1874433559133568:12345-192.168.202.1@tcp:101:dd.0 Request processed in 11035us (11285us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1787599799.812071:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 43 00000100:00100000:2.0:1787599799.814865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.814967:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559133952 00000100:00100000:0.0:1787599799.814994:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559133952 00000100:00100000:0.0:1787599799.815054:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:0.0:1787599799.815065:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+24:18766:x1874433559133952:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1787599799.815088:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599799.815110:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13fa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1e8 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815145:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815160:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815172:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815295:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d13fa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 26 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815314:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 25 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.815322:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.815325:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787599799.815328:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6e00, rc 0) 00000100:00100000:0.0:1787599799.815402:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+25:18766:x1874433559133952:12345-192.168.202.1@tcp:101:dd.0 Request processed in 338us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.815409:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 44 00000100:00100000:1.0:1787599799.817552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599799.817694:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134208 00000100:00100000:3.0:1787599799.817704:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134208 00000100:00100000:3.0:1787599799.817765:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 45 00000100:00100000:3.0:1787599799.817776:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+25:18766:x1874433559134208:12345-192.168.202.1@tcp:36:dd.0 00010000:00010000:3.0:1787599799.818042:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.818060:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.818069:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787599799.818130:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:3.0:1787599799.818152:0:22662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bed39f4 reply state 000000006216b9b4 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.818164:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599799.818171:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:3.0:1787599799.818174:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787599799.818177:0:22662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787599799.818278:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134208:12345-192.168.202.1@tcp:36:dd.0 Request processed in 501us (735us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787599799.818285:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 45 00000020:00080000:3.0:1787599799.818290:0:22662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787599799.823953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.826590:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134336 00000100:00100000:0.0:1787599799.826623:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134336 00000100:00100000:0.0:1787599799.826927:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:0.0:1787599799.826937:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134336:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1787599799.826957:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599799.826975:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d140f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1ef expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.827028:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d140f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1ef expref: 29 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.827045:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d140f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1ef expref: 29 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.827065:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.827069:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599799.827072:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6000, rc 0) 00000100:00100000:0.0:1787599799.827137:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+29:18766:x1874433559134336:12345-192.168.202.1@tcp:101:dd.0 Request processed in 202us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.827142:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 46 00000100:00100000:3.0:1787599799.845160:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599799.845186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b366619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578118784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787599799.845270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599799.845381:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578118784 00000100:00100000:1.0:1787599799.845389:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578118784 00000100:00100000:1.0:1787599799.845462:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599799.845472:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578118784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787599799.845502:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787599799.845551:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874433578118784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599799.845557:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787599799.845607:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b366619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1874433578118784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787599799.845675:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599799.854353:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.854475:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134592 00000100:00100000:0.0:1787599799.854486:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134592 00000100:00100000:0.0:1787599799.854557:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:0.0:1787599799.854568:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+29:18766:x1874433559134592:12345-192.168.202.1@tcp:103:dd.0 00010000:00010000:0.0:1787599799.854585:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599799.854611:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d140f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1ef expref: 29 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.854650:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.854656:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787599799.858587:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134592:12345-192.168.202.1@tcp:103:dd.0 Request processed in 4007us (4231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.858735:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 2 00000100:00100000:3.0:1787599799.863722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599799.863827:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134720 00000100:00100000:1.0:1787599799.863837:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134720 00000100:00100000:1.0:1787599799.863886:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:1.0:1787599799.863896:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134720:12345-192.168.202.1@tcp:58:dd.0 00010000:00010000:1.0:1787599799.863997:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.864027:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599799.864038:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787599799.865686:0:22662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787599799.865716:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1787599799.866650:0:22662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1787599799.866869:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134720:12345-192.168.202.1@tcp:58:dd.0 Request processed in 2969us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599799.866880:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 47 00000100:00100000:2.0:1787599799.870146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599799.870264:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134848 00000100:00100000:0.0:1787599799.870276:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134848 00000100:00100000:0.0:1787599799.870345:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 48 00000100:00100000:0.0:1787599799.870356:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+28:18766:x1874433559134848:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:0.0:1787599799.870594:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599799.870617:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1f6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870669:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870681:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870702:0:22661:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870716:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870731:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599799.870747:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599799.870752:0:22661:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599799.870761:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6000, rc 0) 00000100:00100000:0.0:1787599799.870861:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+29:18766:x1874433559134848:12345-192.168.202.1@tcp:101:dd.0 Request processed in 506us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599799.870869:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 48 00000040:00080000:1.0:1787599800.166868:0:22695:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787599800.166877:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787599800.166901:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787599800.166910:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787599800.167391:0:22695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b366619f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1874433578118912:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787599800.167486:0:22695:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787599800.187530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.187640:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559134976 00000100:00100000:0.0:1787599800.187649:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559134976 00000100:00100000:0.0:1787599800.187945:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00100000:0.0:1787599800.187959:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559134976:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599800.187994:0:24662:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599800.188135:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559134976:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 180us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.188144:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 49 00000100:00080000:2.0:1787599800.188860:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787599800.188993:0:22695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b366619f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1874433578118912:192.168.202.1@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787599800.204907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.206420:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559135104 00000100:00100000:0.0:1787599800.206433:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559135104 00000100:00100000:0.0:1787599800.206506:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:0.0:1787599800.206517:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+29:18767:x1874433559135104:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.206613:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206629:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206641:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206673:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206679:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206686:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206733:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206743:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206750:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599800.206853:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787599800.206858:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599800.206874:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206885:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206891:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206897:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206911:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.206916:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206923:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206935:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b343b14d00) 00010000:00010000:0.0:1787599800.206938:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599800.206943:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206948:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d1424 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206963:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206969:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206975:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206980:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.206983:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.206988:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207019:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff96b34de5f200) 00010000:00010000:0.0:1787599800.207022:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599800.207025:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207031:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d142b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207046:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207052:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207057:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207062:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.207064:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207070:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207077:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599800.207079:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599800.207082:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.207088:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1432 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599800.207189:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+29:18767:x1874433559135104:12345-192.168.202.1@tcp:34:lhsmtool_posix.0 Request processed in 672us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.207198:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 50 00000100:00100000:3.0:1787599800.213744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.214282:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559135360 00000100:00100000:0.0:1787599800.214293:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559135360 00000100:00100000:0.0:1787599800.214355:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:0.0:1787599800.214377:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+29:18767:x1874433559135360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.214399:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.214422:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6c00/0x5d2988b0929d1439 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc1fd expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214533:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214548:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214559:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599800.214570:0:24662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787599800.214649:0:24662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214657:0:24662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214664:0:24662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214704:0:24662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.214709:0:24662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214717:0:24662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214922:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:0.0:1787599800.214925:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787599800.214930:0:24662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214937:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1440 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214981:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6c00/0x5d2988b0929d1439 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1fd expref: 31 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.214991:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff96b343b14d00) 00010000:00010000:0.0:1787599800.214993:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787599800.214998:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6c00/0x5d2988b0929d1439 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1fd expref: 31 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.215158:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6c00, rc 0) 00000100:00100000:0.0:1787599800.215237:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559135360:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 872us (1511us total) trans 12884901908 rc 301/301 00000100:00100000:0.0:1787599800.215245:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 51 00000100:00100000:3.0:1787599800.220678:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.220900:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559135488 00000100:00100000:0.0:1787599800.220927:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559135488 00000100:00100000:0.0:1787599800.220978:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:0.0:1787599800.220990:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559135488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787599800.221038:0:22659:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787599800.221172:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559135488:12345-192.168.202.1@tcp:53:lhsmtool_posix.0 Request processed in 183us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.221180:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 52 00000100:00100000:2.0:1787599800.235993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.236158:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559135744 00000100:00100000:0.0:1787599800.236170:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559135744 00000100:00100000:0.0:1787599800.236251:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:0.0:1787599800.236264:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+30:18767:x1874433559135744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.236287:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.236306:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6c00/0x5d2988b0929d144e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc204 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787599800.236706:0:24662:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1787599800.236714:0:24662:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1787599800.236852:0:24662:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787599800.237699:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1455 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.237721:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1455 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.237936:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1455 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.238233:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6c00/0x5d2988b0929d144e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc204 expref: 33 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.238272:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1455 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc204 expref: 32 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.238281:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b34de5f200) 00010000:00010000:0.0:1787599800.238285:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787599800.238288:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7800, rc 0) 00000100:00100000:0.0:1787599800.238364:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+32:18767:x1874433559135744:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 2102us (2384us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1787599800.238381:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 53 00000100:00100000:3.0:1787599800.243970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.244165:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136000 00000100:00100000:0.0:1787599800.244175:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136000 00000100:00100000:0.0:1787599800.244238:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:0.0:1787599800.244250:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+32:18767:x1874433559136000:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.244314:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599800.244342:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1455 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc204 expref: 32 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244362:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b34de5f200) 00010000:00010000:0.0:1787599800.244386:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599800.244411:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244425:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244435:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244466:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244474:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244481:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244525:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244532:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244539:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244545:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.244549:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244556:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244564:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599800.244567:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599800.244571:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244576:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d1463 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244593:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244611:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244617:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244622:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b7000 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.244625:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244631:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244639:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x8acd6573 (ffff96b34de5fc00) 00010000:00010000:0.0:1787599800.244640:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787599800.244643:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.244649:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d146a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8acd6573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599800.244879:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+31:18767:x1874433559136000:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 630us (917us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787599800.244886:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 54 00000100:00100000:3.0:1787599800.247997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.248176:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136128 00000100:00100000:1.0:1787599800.248186:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136128 00000100:00100000:1.0:1787599800.248345:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:1.0:1787599800.248357:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+31:18767:x1874433559136128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787599800.248387:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787599800.248410:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de600/0x5d2988b0929d1471 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc20b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248465:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfc00/0x5d2988b0929d1478 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248477:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfc00/0x5d2988b0929d1478 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248486:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfc00/0x5d2988b0929d1478 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248594:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de600/0x5d2988b0929d1471 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc20b expref: 33 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248612:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dfc00/0x5d2988b0929d1478 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc20b expref: 32 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.248620:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:1.0:1787599800.248622:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599800.248625:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36e4dfc00, rc 0) 00000100:00100000:1.0:1787599800.248684:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+32:18767:x1874433559136128:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 329us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599800.248690:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 55 00000100:00100000:2.0:1787599800.253134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.253235:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136384 00000100:00100000:0.0:1787599800.253247:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136384 00000100:00100000:0.0:1787599800.253313:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:0.0:1787599800.253340:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+32:18767:x1874433559136384:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.253438:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.253455:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.253466:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787599800.253639:0:22659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787599800.253649:0:22659:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 746872855958ns, next at 747872853442ns, rc = 0 00000004:00010000:0.0:1787599800.253696:0:22659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c05d9e00 reply state 0000000037f8c824 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.253708:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.253715:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:0.0:1787599800.253718:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787599800.253735:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599800.253855:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+34:18767:x1874433559136384:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 516us (730us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1787599800.253863:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 56 00000100:00100000:3.0:1787599800.256531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.256607:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136512 00000100:00100000:0.0:1787599800.256617:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136512 00000100:00100000:0.0:1787599800.256668:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:0.0:1787599800.256677:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+34:18767:x1874433559136512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.256698:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.256737:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc212 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.256784:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 35 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.256824:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 35 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.256842:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:0.0:1787599800.256845:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787599800.256848:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7000, rc 0) 00000100:00100000:0.0:1787599800.256890:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+35:18767:x1874433559136512:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 214us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.256897:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 57 00000100:00100000:3.0:1787599800.260421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.260610:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136640 00000100:00100000:2.0:1787599800.260621:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136640 00000100:00100000:2.0:1787599800.260694:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599800.260705:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2403:x1874433559136640:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787599800.260994:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+6:2403:x1874433559136640:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 290us (582us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787599800.261336:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 25 00000100:00100000:2.0:1787599800.264862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.265320:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559136896 00000100:00100000:1.0:1787599800.265330:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559136896 00000100:00100000:1.0:1787599800.266161:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:1.0:1787599800.266176:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a4010e-4a97-45be-a56f-11284301c754+35:18767:x1874433559136896:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787599800.266738:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07a4010e-4a97-45be-a56f-11284301c754+36:18767:x1874433559136896:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 284us (1670us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1787599800.266763:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 9 00000100:00100000:3.0:1787599800.269121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.269240:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137152 00000100:00100000:0.0:1787599800.269251:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137152 00000100:00100000:0.0:1787599800.269308:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:0.0:1787599800.269318:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+36:18767:x1874433559137152:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599800.269447:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+36:18767:x1874433559137152:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 129us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.269455:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 58 00000100:00100000:3.0:1787599800.271484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.271542:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137280 00000100:00100000:0.0:1787599800.271550:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137280 00000100:00100000:0.0:1787599800.271614:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:0.0:1787599800.271624:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+36:18767:x1874433559137280:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.271642:0:24662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.271681:0:24662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d148d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc219 expref: -99 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271759:0:24662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271774:0:24662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271785:0:24662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787599800.271888:0:24662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787599800.271908:0:24662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271936:0:24662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d148d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc219 expref: 38 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271953:0:24662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc219 expref: 37 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.271961:0:24662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:0.0:1787599800.271964:0:24662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787599800.271969:0:24662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b7800, rc 0) 00000100:00100000:0.0:1787599800.272037:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+37:18767:x1874433559137280:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 414us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.272044:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 59 00000100:00100000:2.0:1787599800.274924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.275267:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137408 00000100:00100000:0.0:1787599800.275278:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137408 00000100:00100000:0.0:1787599800.275346:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:0.0:1787599800.275355:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a4010e-4a97-45be-a56f-11284301c754+6:2405:x1874433559137408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.275373:0:24165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.275394:0:24165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc220 expref: -99 pid: 24165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787599800.275421:0:24165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c9bb8, blocks: 0x0 00010000:00010000:0.0:1787599800.275441:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=746s v=(0 0) 00010000:00010000:0.0:1787599800.275445:0:24165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599800.275454:0:24165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 7 pid: 24165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.275476:0:24165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 7 pid: 24165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.275490:0:24165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6c00, rc 0) 00000100:00100000:0.0:1787599800.275553:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a4010e-4a97-45be-a56f-11284301c754+7:2405:x1874433559137408:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 198us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.275560:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 26 00000100:00100000:2.0:1787599800.277938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.277980:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137664 00000100:00100000:0.0:1787599800.277991:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137664 00000100:00100000:0.0:1787599800.278059:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:0.0:1787599800.278071:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+37:18767:x1874433559137664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787599800.278188:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+37:18767:x1874433559137664:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.278282:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 60 00000100:00100000:3.0:1787599800.280061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.280116:0:24662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137792 00000100:00100000:0.0:1787599800.280126:0:24662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137792 00000100:00100000:0.0:1787599800.280178:0:24662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:0.0:1787599800.280188:0:24662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+37:18767:x1874433559137792:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787599800.283473:0:22640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:1.0:1787599800.283491:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787599800.283542:0:22640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1787599800.283681:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283708:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283716:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283733:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599800.283738:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283747:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283765:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff96b343b14b00) 00010000:00010000:3.0:1787599800.283768:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599800.283773:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283778:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c200/0x5d2988b0929d12c6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283842:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283848:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283853:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283857:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6ca00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599800.283866:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283872:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283880:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:3.0:1787599800.283882:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599800.283884:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283890:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6ca00/0x5d2988b0929d12cd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283902:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283908:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283912:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283916:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599800.283919:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283924:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283930:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96b34de5f900) 00010000:00010000:3.0:1787599800.283932:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599800.283941:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283946:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d200/0x5d2988b0929d1383 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283962:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283968:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283973:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283977:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758e00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599800.283980:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283984:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.283992:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:3.0:1787599800.283993:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787599800.283996:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284000:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b243758e00/0x5d2988b0929d1408 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284023:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284038:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284044:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284049:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b3778b6400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:3.0:1787599800.284052:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284058:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284067:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:3.0:1787599800.284069:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787599800.284072:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.284077:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6400/0x5d2988b0929d147f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.284451:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578119040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787599800.284526:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.284641:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578119040 00000100:00100000:2.0:1787599800.284650:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578119040 00000100:00100000:2.0:1787599800.284704:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787599800.284714:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578119040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787599800.284870:0:24167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787599800.284874:0:24167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787599800.284877:0:24167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787599800.284879:0:24167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787599800 -> 1787599800 00002000:00010000:2.0:1787599800.284881:0:24167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787599800.284918:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1874433578119040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (393us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787599800.284923:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1787599800.284956:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96b2440ed880/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787599800.284961:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578119040:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787599800.285161:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285167:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285171:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285174:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef3d400 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:0.0:1787599800.285176:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285180:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285189:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff96b343b14600) 00010000:00010000:0.0:1787599800.285191:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787599800.285193:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.285197:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef3d400/0x5d2988b0929d1328 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599800.285336:0:24662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2433e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07a4010e-4a97-45be-a56f-11284301c754+15:18767:x1874433559137792:12345-192.168.202.1@tcp:44:lhsmtool_posix.0 Request processed in 5146us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599800.285345:0:24662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 61 00000100:00100000:3.0:1787599800.288595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.290087:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559137920 00000100:00100000:1.0:1787599800.290102:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559137920 00000100:00100000:1.0:1787599800.290168:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:1.0:1787599800.290179:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07a4010e-4a97-45be-a56f-11284301c754+7:2405:x1874433559137920:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787599800.290473:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:07a4010e-4a97-45be-a56f-11284301c754+7:2405:x1874433559137920:12345-192.168.202.1@tcp:16:lhsmtool_posix.0 Request processed in 295us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599800.290482:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 28 00000100:00100000:2.0:1787599800.295465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.295610:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138176 00000100:00100000:0.0:1787599800.295620:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138176 00000100:00100000:0.0:1787599800.295681:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:0.0:1787599800.295691:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+15:18767:x1874433559138176:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.295745:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787599800.295775:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7800/0x5d2988b0929d1494 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc219 expref: 15 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.295826:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:0.0:1787599800.295832:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787599800.295864:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d14a2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.295877:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d14a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.295887:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d14a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787599800.296007:0:22659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c087bd7e reply state 000000006ff86bb3 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d14a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.296019:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6800/0x5d2988b0929d14a2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.296025:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:0.0:1787599800.296028:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787599800.296031:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787599800.296118:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07a4010e-4a97-45be-a56f-11284301c754+16:18767:x1874433559138176:12345-192.168.202.1@tcp:36:lhsmtool_posix.0 Request processed in 428us (663us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1787599800.296143:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 62 00000100:00100000:1.0:1787599800.299572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:0.0:1787599800.300084:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138304 00000100:00100000:0.0:1787599800.300094:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138304 00000100:00100000:0.0:1787599800.300138:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:0.0:1787599800.300146:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+7:18767:x1874433559138304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787599800.300164:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787599800.300182:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc227 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.300227:0:24167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.300238:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599800.300241:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787599800.300247:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.300283:0:24167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787599800.300294:0:24167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787599800.300307:0:24167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24167:1874433578119168:192.168.202.1@tcp:104: 00000100:00100000:0.0:1787599800.300383:0:24167:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b3483b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787599800.302971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.303081:0:24167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243757b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24167:1874433578119168:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599800.303126:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.303143:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b3778b6a00, rc 0) 00000100:00100000:1.0:1787599800.303193:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07a4010e-4a97-45be-a56f-11284301c754+8:18767:x1874433559138304:12345-192.168.202.1@tcp:101:lhsmtool_posix.0 Request processed in 3047us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599800.303200:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 29 00000100:00100000:3.0:1787599800.303581:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138432 00000100:00100000:3.0:1787599800.303590:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138432 00010000:00010000:3.0:1787599800.304458:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.304602:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:1.0:1787599800.304629:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+8:2404:x1874433559138432:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787599800.304659:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787599800.304681:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.304705:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.304738:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001598f84/0x5d2988b0929d149b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc220 expref: 8 pid: 24165 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.304754:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599800.304758:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599800.304765:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.304774:0:22646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.304830:0:22646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.304845:0:22646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22646:1874433578119296:192.168.202.1@tcp:105: 00000100:00100000:0.0:1787599800.305048:0:22646:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599800.307946:0:22646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22646:1874433578119296:192.168.202.1@tcp:105: 00010000:00010000:1.0:1787599800.307976:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787599800.308056:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+7:2404:x1874433559138432:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 3443us (5095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787599800.308068:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 19 00000100:00100000:0.0:1787599800.310108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.310411:0:24165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138560 00000100:00100000:1.0:1787599800.310422:0:24165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138560 00000100:00100000:1.0:1787599800.310478:0:24165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:1.0:1787599800.310485:0:24165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a4010e-4a97-45be-a56f-11284301c754+7:2404:x1874433559138560:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787599800.310630:0:24165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787599800.310634:0:24165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787599799 00002000:00010000:1.0:1787599800.310636:0:24165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787599798 00002000:00010000:1.0:1787599800.310639:0:24165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787599800 -> 1787599799 00002000:00010000:1.0:1787599800.310642:0:24165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787599800.310705:0:24165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07a4010e-4a97-45be-a56f-11284301c754+8:2404:x1874433559138560:12345-192.168.202.1@tcp:2:lhsmtool_posix.0 Request processed in 219us (602us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787599800.310710:0:24165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 30 00000100:00100000:0.0:1787599800.313450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.313553:0:24501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138688 00000100:00100000:1.0:1787599800.313564:0:24501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138688 00000100:00100000:1.0:1787599800.313668:0:24501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:1.0:1787599800.313681:0:24501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+8:2404:x1874433559138688:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787599800.313743:0:24501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.313765:0:24501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.313773:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787599800.313816:0:24501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787599800.313822:0:24501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.313864:0:24501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.313878:0:24501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 8 pid: 24167 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.313894:0:24501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24501:1874433578119424:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599800.313990:0:24501:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787599800.317218:0:24501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24501:1874433578119424:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599800.317252:0:24501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599800.319272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.319356:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559138816 00000100:00100000:2.0:1787599800.319365:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559138816 00010000:00010000:2.0:1787599800.319406:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 9 pid: 24167 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599800.319438:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 20 00000100:00100000:2.0:1787599800.319446:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+9:2403:x1874433559138816:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599800.319475:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599800.319495:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 9 pid: 24167 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.319505:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 9 pid: 24167 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.319525:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fe87b0/0x5d2988b0929d14a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc227 expref: 9 pid: 24167 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.319539:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599800.319542:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787599800.319547:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.319554:0:22645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.319584:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599800.319653:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07a4010e-4a97-45be-a56f-11284301c754+8:2403:x1874433559138816:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 205us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.319661:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 20 00010000:00010000:3.0:1787599800.319979:0:24501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320080:0:24501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320103:0:24501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320111:0:24501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320119:0:24501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320124:0:24501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36e4de600 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599800.320127:0:24501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320133:0:24501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320142:0:24501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.320146:0:24501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088f734d2/0x5d2988b0929d14b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599800.320219:0:24501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07a4010e-4a97-45be-a56f-11284301c754+7:2404:x1874433559138688:12345-192.168.202.1@tcp:1:lhsmtool_posix.0 Request processed in 6539us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599800.320229:0:24501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 31 00000100:00100000:3.0:1787599800.323490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.323586:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139072 00000100:00100000:1.0:1787599800.323595:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139072 00000100:00100000:1.0:1787599800.323725:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 63 00000100:00100000:1.0:1787599800.323744:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+16:18767:x1874433559139072:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787599800.323865:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.323882:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.323908:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.323944:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.323957:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 16 pid: 22659 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.323970:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578119552:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599800.324040:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b24346e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787599800.327489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.327562:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139200 00000100:00100000:2.0:1787599800.327573:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139200 00010000:00010000:2.0:1787599800.327611:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 17 pid: 22659 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599800.327679:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 21 00000100:00100000:2.0:1787599800.327690:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07a4010e-4a97-45be-a56f-11284301c754+17:2403:x1874433559139200:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599800.327706:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599800.327713:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 17 pid: 22659 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.327726:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 17 pid: 22659 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.327758:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:2.0:1787599800.327764:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 17 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.327775:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.327783:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.328068:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.328091:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599800.328149:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2436ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07a4010e-4a97-45be-a56f-11284301c754+17:2403:x1874433559139200:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 459us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.328157:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 21 00010000:00010000:1.0:1787599800.328750:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6e00/0x5d2988b0929d1401 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1e8 expref: 16 pid: 22659 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.328767:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578119552:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599800.328787:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.328969:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.328975:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.329172:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.329183:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 16 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.329197:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.329237:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 16 pid: 24662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.329250:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 16 pid: 24662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.329265:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578119680:192.168.202.1@tcp:104: 00000100:00100000:1.0:1787599800.329339:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b36efe99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599800.334295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.334433:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139328 00000100:00100000:2.0:1787599800.334452:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139328 00010000:00010000:2.0:1787599800.334498:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 17 pid: 24662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787599800.334532:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 22 00000100:00100000:2.0:1787599800.334541:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+17:2404:x1874433559139328:12345-192.168.202.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787599800.334556:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787599800.334564:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 17 pid: 24662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.334576:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 17 pid: 24662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.334608:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:2.0:1787599800.334614:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.334973:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.334980:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.334999:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787599800.335057:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07a4010e-4a97-45be-a56f-11284301c754+17:2404:x1874433559139328:12345-192.168.202.1@tcp:103:ldlm_bl.0 Request processed in 516us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.335065:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 22 00010000:00010000:1.0:1787599800.335584:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b7000/0x5d2988b0929d1486 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc212 expref: 16 pid: 24662 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.335604:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578119680:192.168.202.1@tcp:104: 00010000:00010000:1.0:1787599800.335636:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.335645:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.335652:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787599800.335772:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1787599800.336073:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:1.0:1787599800.336111:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787599800.336201:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22662:1874433578119808:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787599800.336268:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599800.336306:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b353238900 going to sleep for 11 seconds 00000100:00100000:2.0:1787599800.336744:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578119808 00000100:00100000:2.0:1787599800.336752:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578119808 00000100:00100000:2.0:1787599800.336989:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787599800.337000:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22662:x1874433578119808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787599800.337091:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22662:x1874433578119808:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.337097:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787599800.337173:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22662:1874433578119808:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787599800.337358:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:1.0:1787599800.337434:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22662:1874433578119936:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787599800.337465:0:22662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787599800.338565:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee53180 going to sleep for 11 seconds 00000100:00100000:0.0:1787599800.338714:0:25458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578119936 00000100:00100000:0.0:1787599800.338729:0:25458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578119936 00000100:00100000:0.0:1787599800.338768:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787599800.338776:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22662:x1874433578119936:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787599800.338968:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b377b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22662:x1874433578119936:12345-0@lo:1000:mdt00_002.0 Request processed in 192us (1502us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1787599800.338976:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787599800.339122:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b377b0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22662:1874433578119936:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787599800.339163:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339173:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339180:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339186:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36e4dec00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599800.339190:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339197:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339224:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:1.0:1787599800.339227:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599800.339232:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339254:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dec00/0x5d2988b0929d14be lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339285:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339291:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339296:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339301:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36e4de800 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599800.339303:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339309:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339317:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:1.0:1787599800.339319:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787599800.339326:0:22662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339335:0:22662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339343:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.339423:0:22662:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96b3778b6000/0x5d2988b0929d141d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc1f6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.339436:0:22662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578120064:192.168.202.1@tcp:105: 00000100:00100000:1.0:1787599800.339508:0:22662:0:(client.c:2715:ptlrpc_set_wait()) set ffff96b34ee539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787599800.343938:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:1.0:1787599800.344048:0:22662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22662:1874433578120064:192.168.202.1@tcp:105: 00010000:00010000:1.0:1787599800.344078:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344088:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4de800/0x5d2988b0929d1416 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344121:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344134:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344145:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344155:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344161:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344167:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344194:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36e4dee00 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599800.344198:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344214:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344227:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:1.0:1787599800.344230:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787599800.344234:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344239:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4dee00/0x5d2988b0929d14c5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344250:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344256:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344262:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344266:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36e4df200 already unused, calling callback (ffffffffc175b4f0) 00010000:00010000:1.0:1787599800.344269:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344274:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344292:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:1.0:1787599800.344294:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787599800.344297:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.344302:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36e4df200/0x5d2988b0929d14b7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.344544:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07a4010e-4a97-45be-a56f-11284301c754+19:18767:x1874433559139072:12345-192.168.202.1@tcp:57:lhsmtool_posix.0 Request processed in 20801us (21061us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1787599800.344554:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 63 00000020:00080000:1.0:1787599800.344560:0:22662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787599800.344712:0:22695:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787599800.344717:0:22695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787599800.344756:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787599800.344762:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787599800.347496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.348141:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139456 00000100:00100000:2.0:1787599800.348153:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139456 00000100:00100000:2.0:1787599800.348193:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139712 00000100:00100000:2.0:1787599800.348197:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139712 00000100:00100000:2.0:1787599800.348225:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1787599800.348237:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b34425f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+20:18766:x1874433559139456:12345-192.168.202.1@tcp:49:dd.0 00000100:00100000:2.0:1787599800.348471:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b34425f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+20:18766:x1874433559139456:12345-192.168.202.1@tcp:49:dd.0 Request processed in 235us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.348479:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 10 00000100:00100000:2.0:1787599800.348533:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 11 00000100:00100000:2.0:1787599800.348540:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+19:18767:x1874433559139712:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787599800.348823:0:22663:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787599800.348862:0:22663:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:2.0:1787599800.348897:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348915:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348927:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348935:0:22663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348957:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348963:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.348990:0:22663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787599800.349042:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07a4010e-4a97-45be-a56f-11284301c754+21:18767:x1874433559139712:12345-192.168.202.1@tcp:35:lhsmtool_posix.0 Request processed in 501us (1558us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1787599800.349049:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 11 00000020:00080000:2.0:1787599800.349053:0:22663:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787599800.349183:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787599800.349190:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.349197:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6d200 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599800.349201:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.349219:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.349234:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96b242158c00) 00010000:00010000:3.0:1787599800.349237:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787599800.349241:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.349247:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6d200/0x5d2988b0929d14cc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.349260:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599800.349262:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599800.349264:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787599800.354985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:2.0:1787599800.355106:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139840 00000100:00100000:2.0:1787599800.355116:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139840 00000100:00100000:2.0:1787599800.355177:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599800.355188:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+21:18766:x1874433559139840:12345-192.168.202.1@tcp:101:dd.0 00010000:00010000:2.0:1787599800.355223:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787599800.355245:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c400/0x5d2988b0929d14d3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3b8b628210adc22e expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355286:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d14da lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355300:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d14da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355311:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d14da lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355560:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6c400/0x5d2988b0929d14d3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc22e expref: 23 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355588:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96b36ef6cc00/0x5d2988b0929d14da lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.1@tcp remote: 0x3b8b628210adc22e expref: 22 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.355598:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96b34de5f000) 00010000:00010000:2.0:1787599800.355601:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787599800.355605:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96b36ef6cc00, rc 0) 00000100:00100000:2.0:1787599800.355970:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07a4010e-4a97-45be-a56f-11284301c754+22:18766:x1874433559139840:12345-192.168.202.1@tcp:101:dd.0 Request processed in 782us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.355978:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 64 00000100:00100000:2.0:1787599800.357197:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787599800.357226:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578120320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599800.357290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.357341:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787599800.357350:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578120192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599800.357379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.357412:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120320 00000100:00100000:2.0:1787599800.357420:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120320 00000100:00100000:2.0:1787599800.357460:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120192 00000100:00100000:2.0:1787599800.357463:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120192 00000100:00100000:2.0:1787599800.357484:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599800.357492:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578120320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787599800.357519:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599800.357560:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2440ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578120320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.357566:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787599800.357583:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787599800.357603:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578120192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787599800.357614:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787599800.357720:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1874433578120192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.358236:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787599800.358257:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787599800.358293:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578120320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787599800.358328:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24347a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1874433578120192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787599800.362888:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b36661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578120448:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.362969:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363018:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b34e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578120960:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363046:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363070:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578121472:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363128:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787599800.363134:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578120832:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363177:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578121344:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363406:0:25458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120832 00000100:00100000:2.0:1787599800.363415:0:25458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120832 00000100:00100000:2.0:1787599800.363466:0:25458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599800.363475:0:25458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578120832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363530:0:25458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578120832:12345-0@lo:400:kworker.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.363557:0:25458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787599800.363587:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578120576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578121088:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363674:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578121600:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363711:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787599800.363717:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b24375d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578120704:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363739:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363750:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578121216:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363769:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787599800.363816:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120960 00000100:00100000:2.0:1787599800.363820:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120960 00000100:00100000:2.0:1787599800.363859:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787599800.363866:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578120960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.363900:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b2443e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874433578120960:12345-0@lo:400:kworker.0 Request processed in 34us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.363905:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787599800.363925:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787599800.363936:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120576 00000100:00100000:2.0:1787599800.363939:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120576 00000100:00100000:2.0:1787599800.363959:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599800.363965:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578120576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364001:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1874433578120576:12345-0@lo:400:kworker.0 Request processed in 36us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364015:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787599800.364052:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2440efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1874433578120576:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364078:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578120832:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364089:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b34e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1874433578120960:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364112:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120448 00000100:00100000:2.0:1787599800.364115:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120448 00000100:00100000:2.0:1787599800.364139:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787599800.364145:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3648:x1874433578120448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364180:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b37b4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:559ac968-b0ab-4af8-8146-7f269e4a29a3+24:3648:x1874433578120448:12345-0@lo:400:kworker.0 Request processed in 35us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364186:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787599800.364234:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b36661bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:559ac968-b0ab-4af8-8146-7f269e4a29a3:3648:1874433578120448:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364252:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121472 00000100:00100000:2.0:1787599800.364254:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121472 00000100:00080000:2.0:1787599800.364271:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599800.364291:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121344 00000100:00100000:2.0:1787599800.364294:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121344 00000100:00080000:2.0:1787599800.364304:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599800.364316:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121088 00000100:00100000:2.0:1787599800.364318:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121088 00000100:00100000:2.0:1787599800.364327:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121600 00000100:00100000:2.0:1787599800.364329:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121600 00000100:00080000:2.0:1787599800.364340:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787599800.364350:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578120704 00000100:00100000:2.0:1787599800.364353:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578120704 00000100:00100000:2.0:1787599800.364362:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121216 00000100:00100000:2.0:1787599800.364364:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121216 00000100:00080000:2.0:1787599800.364383:0:22656:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787599800.364399:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599800.364405:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433578121472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364440:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874433578121472:12345-0@lo:400:kworker.0 Request processed in 35us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364445:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787599800.364467:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1874433578121472:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364484:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787599800.364491:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578121344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364522:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874433578121344:12345-0@lo:400:kworker.0 Request processed in 32us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364527:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787599800.364550:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e4a80 x1874433578121344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599800.364560:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1874433578121344:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364577:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599800.364584:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578121088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364621:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1874433578121088:12345-0@lo:400:kworker.0 Request processed in 38us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364627:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787599800.364648:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1874433578121088:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364664:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787599800.364671:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578121600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364702:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1874433578121600:12345-0@lo:400:kworker.0 Request processed in 33us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364714:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1787599800.364738:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96b2443e7100 x1874433578121600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787599816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787599800.364748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1874433578121600:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364765:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599800.364771:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578120704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364831:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b370010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1874433578120704:12345-0@lo:400:kworker.0 Request processed in 61us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364837:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787599800.364859:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b24375d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1874433578120704:0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364880:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599800.364887:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b3434a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578121216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787599800.364921:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b3434a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1874433578121216:12345-0@lo:400:kworker.0 Request processed in 34us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787599800.364926:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787599800.364950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b2443e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1874433578121216:0@lo:400:kworker.0 00000100:00100000:0.0:1787599800.384320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599800.384564:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559139968 00000100:00100000:3.0:1787599800.384575:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559139968 00000100:00100000:3.0:1787599800.384642:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 0 00000100:00100000:3.0:1787599800.384667:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07a4010e-4a97-45be-a56f-11284301c754+7:2404:x1874433559139968:12345-192.168.202.1@tcp:4:dd.0 00002000:00010000:3.0:1787599800.384717:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8c9bb7, atime: 0x6a8c9bb6, ctime: 0x6a8c9bb7, blocks: 0x0 00010000:00010000:3.0:1787599800.384727:0:24171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.384745:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=747s v=(0 0) 00010000:00010000:3.0:1787599800.384750:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787599800.384756:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.384771:0:24171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.387192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.1@tcp (source: 12345-192.168.202.1@tcp) 00000100:00100000:3.0:1787599800.391004:0:24173:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787599800.391270:0:24173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787599800.391628:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433559140096 00000100:00100000:2.0:1787599800.391640:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433559140096 00000100:00100000:2.0:1787599800.402615:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.1@tcp, seq: 1 00000100:00100000:2.0:1787599800.402635:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07a4010e-4a97-45be-a56f-11284301c754+9:2404:x1874433559140096:12345-192.168.202.1@tcp:4:dd.0 00010000:00010000:2.0:1787599800.402677:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.402708:0:25709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599800.402712:0:25709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787599800.402731:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787599800.402748:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787599800.493886:0:24162:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:2.0:1787599800.493902:0:24162:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1787599800.494084:0:24171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787599800.494089:0:24171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1787599799 -> 1787599800 00002000:00010000:1.0:1787599800.494092:0:24171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787599799 -> 1787599800 00002000:00010000:1.0:1787599800.494094:0:24171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1787599800.494113:0:24171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494127:0:24171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494136:0:24171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494143:0:24171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b243758e00 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:1.0:1787599800.494160:0:24171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494170:0:24171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494263:0:24171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787599800.494273:0:24171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059b72e95/0x5d2988b0929d14e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787599800.494386:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366646300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07a4010e-4a97-45be-a56f-11284301c754+7:2404:x1874433559139968:12345-192.168.202.1@tcp:4:dd.0 Request processed in 109714us (110068us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787599800.494400:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 0 00000001:00080000:2.0:1787599800.542029:0:24162:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1787599800.542306:0:25709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1787599800.542314:0:25709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1787599800.542349:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542364:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542380:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542387:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96b36ef6c400 already unused, calling callback (ffffffffc0b4e230) 00010000:00010000:3.0:1787599800.542392:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542419:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542442:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787599800.542450:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f087859f/0x5d2988b0929d14e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787599800.542588:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b24347aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07a4010e-4a97-45be-a56f-11284301c754+5:2404:x1874433559140096:12345-192.168.202.1@tcp:4:dd.0 Request processed in 139951us (155396us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787599800.542601:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.1@tcp, seq: 1 00010000:00010000:3.0:1787599800.677151:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787599801.701328:0:24192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787599801.894009:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b366646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578121728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787599801.894101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599801.894145:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121728 00000100:00100000:0.0:1787599801.894153:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121728 00000100:00100000:0.0:1787599801.894218:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787599801.894228:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578121728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787599801.894264:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787599801.894282:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787599801.894294:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578121856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787599801.894318:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1874433578121728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599801.894327:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787599801.894331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599801.894365:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121856 00000100:00100000:0.0:1787599801.894370:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121856 00000100:00100000:0.0:1787599801.894396:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599801.894398:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787599801.894405:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b366646a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1874433578121728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787599801.894406:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b366640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578121856:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787599801.894408:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578121984:0@lo:13:osp-pre-0-1.0 00000004:00000024:0.0:1787599801.894430:0:22666:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787599801.894445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787599801.894456:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b366640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874433578121856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787599801.894462:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787599801.894607:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1874433578121856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787599801.894661:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874433578121984 00000100:00100000:3.0:1787599801.894664:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874433578121984 00000100:00100000:3.0:1787599801.894700:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787599801.894707:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578121984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787599801.894729:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787599801.894818:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96b243479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874433578121984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787599801.894825:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787599801.894887:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff96b243479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1874433578121984:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787599802.155675:0:25746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787599802.725245:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787599802.793875:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 14378 lines, 14378 kept, 0 dropped, 0 bad.